vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #484
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.TCwyacjWUA', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14(finished: start all VMs, in 52.33 seconds)15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab: waiting for unit setup-gitlab.service17gitlab # Filesystem UUID: b77f10ef-2706-42e3-99f4-93734be5a90918gitlab: waiting for the VM to finish booting19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/si4dwijnqixhw65ahaw8pallzhwym9p2-nixos-system-gitlab-test/init regInfo=/nix/store/4q6q347x34pmsvx0cq8vylrbm1a68hlk-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000001] kvm-clock: using sched offset of 508170076 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000006] tsc: Detected 2400.010 MHz processor67gitlab # [ 0.000866] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000896] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000899] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000942] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002915] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002931] Using GB pages for direct mapping73gitlab # [ 0.003079] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.003087] ACPI: Early table checksum verification disabled75gitlab # [ 0.003090] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.003095] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.003100] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.003107] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.003109] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.003110] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.003112] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.003114] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.003115] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.003116] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.003117] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.003117] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.003118] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.003119] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003365] No NUMA configuration found90gitlab # [ 0.003366] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003369] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005728] Zone ranges:93gitlab # [ 0.005730] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005732] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005733] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005734] Device empty97gitlab # [ 0.005735] Movable zone start for each node98gitlab # [ 0.005736] Early memory node ranges99gitlab # [ 0.005736] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005738] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005739] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005740] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005761] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.006031] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.118759] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.119214] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.119230] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.119272] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.119275] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.119277] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.119278] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.119279] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.119280] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.119283] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.119284] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.119290] TSC deadline timer available117gitlab # [ 0.119295] CPU topo: Max. logical packages: 1118gitlab # [ 0.119295] CPU topo: Max. logical dies: 1119gitlab # [ 0.119296] CPU topo: Max. dies per package: 1120gitlab # [ 0.119300] CPU topo: Max. threads per core: 1121gitlab # [ 0.119300] CPU topo: Num. cores per package: 4122gitlab # [ 0.119301] CPU topo: Num. threads per package: 4123gitlab # [ 0.119301] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.119327] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.119344] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.119347] kvm-guest: setup PV sched yield127gitlab # [ 0.119364] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.119366] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.119367] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.119368] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.119370] Booting paravirtualized kernel on KVM132gitlab # [ 0.119373] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.124102] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.126420] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.126483] kvm-guest: PV spinlocks enabled136gitlab # [ 0.126485] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.126488] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/si4dwijnqixhw65ahaw8pallzhwym9p2-nixos-system-gitlab-test/init regInfo=/nix/store/4q6q347x34pmsvx0cq8vylrbm1a68hlk-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.126589] Unknown kernel command line parameters "regInfo=/nix/store/4q6q347x34pmsvx0cq8vylrbm1a68hlk-closure-info/registration", will be passed to user space.139gitlab # [ 0.126603] random: crng init done140gitlab # [ 0.126604] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.135812] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.140558] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.140662] software IO TLB: area num 4.144gitlab # [ 0.218255] Fallback order for Node 0: 0145gitlab # [ 0.218264] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.218266] Policy zone: Normal147gitlab # [ 0.220948] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.231427] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.245686] allocated 12582912 bytes of page_ext150gitlab # [ 0.256392] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.256395] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.257362] Dynamic Preempt: lazy153gitlab # [ 0.257545] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.257546] rcu: RCU event tracing is enabled.155gitlab # [ 0.257547] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.257548] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.257549] Rude variant of Tasks RCU enabled.158gitlab # [ 0.257549] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.257550] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.257551] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.257583] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.257585] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.257586] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.262294] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.262613] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.262624] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.262757] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.266557] Console: colour VGA+ 80x25169gitlab # [ 0.266560] printk: legacy console [tty0] enabled170gitlab # [ 0.298646] printk: legacy console [ttyS0] enabled171gitlab # [ 0.414007] ACPI: Core revision 20250807172gitlab # [ 0.415075] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.416769] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.417928] x2apic enabled175gitlab # [ 0.418731] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.419805] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.421135] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.422684] kvm-guest: setup PV IPIs179gitlab # [ 0.424382] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.425497] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns181gitlab # [ 0.427393] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010)182gitlab # [ 0.428484] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.429529] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.431391] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.432396] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.433391] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.434391] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.435390] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.436391] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.437391] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.438398] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.439212] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.440389] active return thunk: srso_alias_return_thunk194gitlab # [ 0.441413] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.442390] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.444390] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.445390] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.446391] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.447389] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.448390] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.450389] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.451390] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.452390] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.453390] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.455260] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.456390] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.488687] Freeing SMP alternatives memory: 44K208gitlab # [ 0.489395] pid_max: default: 32768 minimum: 301209gitlab # [ 0.490517] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.491514] landlock: Up and running.211gitlab # [ 0.492392] Yama: becoming mindful.212gitlab # [ 0.493584] LSM support for eBPF active213gitlab # [ 0.494565] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.495542] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.498726] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.500008] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.500401] ... version: 2218gitlab # [ 0.501194] ... bit width: 48219gitlab # [ 0.502030] ... generic counters: 6220gitlab # [ 0.502394] ... generic bitmap: 000000000000003f221gitlab # [ 0.503393] ... fixed-purpose counters: 0222gitlab # [ 0.504214] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.505181] ... value mask: 0000ffffffffffff224gitlab # [ 0.506194] ... max period: 00007fffffffffff225gitlab # [ 0.507194] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.508331] signal: max sigframe size: 3376227gitlab # [ 0.509124] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.509397] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.510606] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.516263] smp: Bringing up secondary CPUs ...231gitlab # [ 0.517473] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.518399] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.522541] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.524200] smpboot: Total of 4 processors activated (19200.08 BogoMIPS)235gitlab # [ 0.525602] Memory: 6011568K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.527394] devtmpfs: initialized237gitlab # [ 0.528596] x86/mm: Memory block size: 128MB238gitlab # [ 0.531578] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.533526] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.534501] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.535730] PM: RTC time: 21:31:06, date: 2026-10-26242gitlab # [ 0.540484] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.542879] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.543456] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.545564] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.546415] audit: initializing netlink subsys (disabled)247gitlab # [ 0.547610] audit: type=2000 audit(1793050266.439:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.547739] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.549393] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.550394] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.551393] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.552393] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.553414] cpuidle: using governor menu254gitlab # [ 0.555640] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.556732] PCI: Using configuration type 1 for base access256gitlab # [ 0.557395] PCI: Using configuration type 1 for extended access257gitlab # [ 0.558638] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.560792] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.562378] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.563341] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.564369] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.569715] ACPI: Added _OSI(Module Device)263gitlab # [ 0.571403] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.573401] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.581865] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.587695] ACPI: Interpreter enabled267gitlab # [ 0.589002] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.589396] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.590332] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.591403] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.593982] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.608326] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.611410] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.615475] acpiphp: Slot [3] registered275gitlab # [ 0.617507] acpiphp: Slot [4] registered276gitlab # [ 0.619471] acpiphp: Slot [5] registered277gitlab # [ 0.621479] acpiphp: Slot [6] registered278gitlab # [ 0.623465] acpiphp: Slot [7] registered279gitlab # [ 0.625489] acpiphp: Slot [8] registered280gitlab # [ 0.627464] acpiphp: Slot [9] registered281gitlab # [ 0.629462] acpiphp: Slot [10] registered282gitlab # [ 0.630464] acpiphp: Slot [11] registered283gitlab # [ 0.632513] acpiphp: Slot [12] registered284gitlab # [ 0.634463] acpiphp: Slot [13] registered285gitlab # [ 0.635439] acpiphp: Slot [14] registered286gitlab # [ 0.637471] acpiphp: Slot [15] registered287gitlab # [ 0.638440] acpiphp: Slot [16] registered288gitlab # [ 0.640437] acpiphp: Slot [17] registered289gitlab # [ 0.641437] acpiphp: Slot [18] registered290gitlab # [ 0.643456] acpiphp: Slot [19] registered291gitlab # [ 0.644442] acpiphp: Slot [20] registered292gitlab # [ 0.646439] acpiphp: Slot [21] registered293gitlab # [ 0.647442] acpiphp: Slot [22] registered294gitlab # [ 0.649470] acpiphp: Slot [23] registered295gitlab # [ 0.651441] acpiphp: Slot [24] registered296gitlab # [ 0.652439] acpiphp: Slot [25] registered297gitlab # [ 0.653423] acpiphp: Slot [26] registered298gitlab # [ 0.654258] acpiphp: Slot [27] registered299gitlab # [ 0.655026] acpiphp: Slot [28] registered300gitlab # [ 0.656415] acpiphp: Slot [29] registered301gitlab # [ 0.657214] acpiphp: Slot [30] registered302gitlab # [ 0.659137] acpiphp: Slot [31] registered303gitlab # [ 0.660514] PCI host bridge to bus 0000:00304gitlab # [ 0.662439] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.665401] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.668400] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.671402] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.674400] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.678467] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.681316] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.686800] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.691571] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.698494] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.701472] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.704401] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.706419] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.709399] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.712988] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.718474] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.723106] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.724744] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.726403] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.727806] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.741484] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.742409] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.743416] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.744590] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.747221] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.752428] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.753400] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.754417] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.768402] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.771078] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.775471] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.777400] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.778416] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.780726] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.784401] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.785367] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.787416] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.789723] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.795438] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.796422] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.798417] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.801120] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.805431] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.806402] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.808417] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.810953] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.815426] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.816401] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.818418] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.820761] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.824429] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.825400] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.826417] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.827399] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.830693] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.833407] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.834417] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.837699] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.841438] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.842400] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.843416] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.845744] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.850434] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.851401] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.852416] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.859606] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.862893] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.865769] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.868759] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.871605] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.878470] iommu: Default domain type: Translated375gitlab # [ 0.880398] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.884395] ACPI: bus type USB registered377gitlab # [ 0.886394] usbcore: registered new interface driver usbfs378gitlab # [ 0.888446] usbcore: registered new interface driver hub379gitlab # [ 0.890459] usbcore: registered new device driver usb380gitlab # [ 0.896266] NetLabel: Initializing381gitlab # [ 0.897399] NetLabel: domain hash size = 128382gitlab # [ 0.899399] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.902602] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.904421] PCI: Using ACPI for IRQ routing385gitlab # [ 0.907623] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.908389] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.908389] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.915403] vgaarb: loaded389gitlab # [ 0.916893] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.919405] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.924584] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.928475] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.929295] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.931073] pnp: PnP ACPI init395gitlab # [ 0.932392] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.941789] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.943519] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.944680] NET: Registered PF_INET protocol family399gitlab # [ 0.947122] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.966908] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.968570] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.970183] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.973034] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.974513] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.976261] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.978041] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.979578] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.981094] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.982223] NET: Registered PF_XDP protocol family410gitlab # [ 0.983167] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.984309] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.985485] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.986716] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.987967] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.989441] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.990533] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.993199] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.996247] PCI: CLS 0 bytes, default 64419gitlab # [ 0.997128] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.997675] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.998301] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.998429] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns423gitlab # [ 1.023464] Initialise system trusted keyrings424gitlab # [ 1.024982] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.037260] Key type asymmetric registered426gitlab # [ 1.038106] Asymmetric key parser 'x509' registered427gitlab # [ 1.039145] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.040926] io scheduler mq-deadline registered429gitlab # [ 1.041761] io scheduler kyber registered430gitlab # [ 1.046590] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.048040] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.050735] Linux agpgart interface v0.103433gitlab # [ 1.051599] ACPI: bus type drm_connector registered434gitlab # [ 1.054555] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.055791] usbserial: USB Serial support registered for generic436gitlab # [ 1.056872] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.056872] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.059425] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.060952] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.062283] NET: Registered PF_INET6 protocol family441gitlab # [ 1.064431] Segment Routing with IPv6442gitlab # [ 1.065236] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.068342] IPI shorthand broadcast: enabled444gitlab # [ 1.073044] sched_clock: Marking stable (917010987, 155766245)->(1098663464, -25886232)445gitlab # [ 1.075088] registered taskstats version 1446gitlab # [ 1.076180] Loading compiled-in X.509 certificates447gitlab # [ 1.086481] Demotion targets for Node 0: null448gitlab # [ 1.087783] Key type .fscrypt registered449gitlab # [ 1.088518] Key type fscrypt-provisioning registered450gitlab # [ 1.089627] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.090665] ima: Allocated hash algorithm: sha1452gitlab # [ 1.091577] ima: No architecture policies found453gitlab # [ 1.092738] PM: Magic number: 14:685:551454gitlab # [ 1.093562] clockevents clockevent2: hash matches455gitlab # [ 1.094493] acpi PNP0C0F:02: hash matches456gitlab # [ 1.096274] RAS: Correctable Errors collector initialized.457gitlab # [ 1.101170] clk: Disabling unused clocks458gitlab # [ 1.101990] PM: genpd: Disabling unused power domains459gitlab # [ 1.300910] Freeing initrd memory: 29392K460gitlab # [ 1.308599] Freeing unused decrypted memory: 2028K461gitlab # [ 1.315366] Freeing unused kernel image (initmem) memory: 3640K462gitlab # [ 1.318311] Write protecting the kernel read-only data: 32768k463gitlab # [ 1.323512] Freeing unused kernel image (text/rodata gap) memory: 1220K464gitlab # [ 1.327668] Freeing unused kernel image (rodata/data gap) memory: 760K465gitlab # [ 1.401039] x86/mm: Checked W+X mappings: passed, no W+X pages found.466gitlab # [ 1.402242] Run /init as init process467gitlab # [ 1.415840] systemd[1]: Inserted module 'autofs4'468gitlab # [ 1.440684] fuse: init (API version 7.45)469gitlab # [ 1.449485] ACPI: \_SB_.LNKC: Enabled at IRQ 10470gitlab # [ 1.456731] ACPI: \_SB_.LNKA: Enabled at IRQ 10471gitlab # [ 1.460094] ACPI: \_SB_.LNKB: Enabled at IRQ 11472gitlab # [ 1.500721] systemd[1]: Successfully made /usr/ read-only.473gitlab # [ 1.836704] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)474gitlab # [ 1.854558] systemd[1]: Detected virtualization kvm.475gitlab # [ 1.855562] systemd[1]: Detected architecture x86-64.476gitlab # [ 1.856555] systemd[1]: Running in initrd.477gitlab # [ 1.857717] systemd[1]: Initializing machine ID from random generator.478gitlab # [ 1.859037] systemd[1]: Hostname set to <gitlab>.479gitlab # [ 1.964819] systemd[1]: bpf-restrict-fs: LSM BPF program attached480gitlab # [ 2.012092] systemd[1]: Queued start job for default target Initrd Default Target.481gitlab # [ 2.021501] systemd[1]: Created slice Slice /system/modprobe.482gitlab # [ 2.022827] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.483gitlab # [ 2.024391] systemd[1]: Expecting device /dev/disk/by-label/nix-store...484gitlab # [ 2.025650] systemd[1]: Expecting device /dev/disk/by-label/nixos...485gitlab # [ 2.026900] systemd[1]: Reached target Path Units.486gitlab # [ 2.027820] systemd[1]: Reached target Slice Units.487gitlab # [ 2.028750] systemd[1]: Reached target Swaps.488gitlab # [ 2.029607] systemd[1]: Reached target Timer Units.489gitlab # [ 2.030686] systemd[1]: Listening on D-Bus System Message Bus Socket.490gitlab # [ 2.031999] systemd[1]: Listening on Journal Socket (/dev/log).491gitlab # [ 2.033301] systemd[1]: Listening on Journal Sockets.492gitlab # [ 2.034383] systemd[1]: Listening on udev Control Socket.493gitlab # [ 2.035507] systemd[1]: Listening on udev Kernel Socket.494gitlab # [ 2.036616] systemd[1]: Reached target Socket Units.495gitlab # [ 2.038714] systemd[1]: Starting Create List of Static Device Nodes...496gitlab # [ 2.041122] systemd[1]: Starting Load Kernel Module 9pnet_virtio...497gitlab # [ 2.043406] systemd[1]: Starting Load Kernel Module configfs...498gitlab # [ 2.048862] systemd[1]: Starting Journal Service...499gitlab # [ 2.051143] systemd[1]: Starting Load Kernel Modules...500gitlab # [ 2.052226] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os501gitlab # [ 2.059033] systemd[1]: Starting Coldplug All udev Devices...502gitlab # [ 2.071390] systemd[1]: Finished Create List of Static Device Nodes.503gitlab # [ 2.075186] systemd-journald[91]: Collecting audit messages is disabled.504gitlab # [ 2.085892] systemd[1]: modprobe@configfs.service: Deactivated successfully.505gitlab # [ 2.090922] systemd[1]: Finished Load Kernel Module configfs.506gitlab # [ 2.094613] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config507gitlab # [ 2.106147] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...508gitlab # [ 2.118476] netfs: FS-Cache loaded509gitlab # [ 2.123020] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.510gitlab # [ 2.127455] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev511gitlab # [ 2.128687] 9pnet: Installing 9P2000 support512gitlab # [ 2.130288] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.513gitlab # [ 2.132830] systemd[1]: Finished Load Kernel Modules.514gitlab # [ 2.135184] systemd[1]: Starting Apply Kernel Variables...515gitlab # [ 2.137242] systemd[1]: Starting Create Static Device Nodes in /dev...516gitlab # [ 2.140163] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.517gitlab # [ 1.988787] systemd-modules-load[93]: Using 4 probe threads518gitlab # [ 1.990230] systemd-modules-l[ 2.145858] systemd[1]: Finished Load Kernel Module 9pnet_virtio.519gitlab # oad[93]: Inserted module 'virtio_balloon'520gitlab # [ 1.992331] systemd-modules-load[93]: Inserted module 'virtio_gpu'521gitlab # [ 1.993559] systemd-modules-l[ 2.149232] systemd[1]: Started Journal Service.522gitlab # oad[93]: Inserted module 'dm_mod'523gitlab # [ 1.997413] systemd[1]: Finished Apply Kernel Variables.524gitlab # [ 2.000612] systemd[1]: Finished Create Static Device Nodes in /dev.525gitlab # [ 2.002139] systemd[1]: Reached target Preparation for Local File Systems.526gitlab # [ 2.003225] systemd[1]: Reached target Local File Systems.527gitlab # [ 2.004277] systemd[1]: Starting Create System Files and Directories...528gitlab # [ 2.005383] systemd[1]: Starting Rule-based Manager for Device Events and Files...529gitlab # [ 2.016949] systemd[1]: Finished Create System Files and Directories.530gitlab # [ 2.026388] systemd-udevd[114]: Using default interface naming scheme 'v261'.531gitlab # [ 2.037478] systemd[1]: Started Rule-based Manager for Device Events and Files.532gitlab # [ 2.075238] systemd[1]: Finished Coldplug All udev Devices.533gitlab # [ 2.076837] systemd[1]: Reached target System Initialization.534gitlab # [ 2.078394] systemd[1]: Reached target Basic System.535gitlab # [ 2.315658] uhci_hcd 0000:00:01.2: UHCI Host Controller536gitlab # [ 2.316972] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1537gitlab # [ 2.318288] uhci_hcd 0000:00:01.2: detected 2 ports538gitlab # [ 2.319257] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140539gitlab # [ 2.320805] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18540gitlab # [ 2.322156] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1541gitlab # [ 2.323347] usb usb1: Product: UHCI Host Controller542gitlab # [ 2.324287] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd543gitlab # [ 2.325274] usb usb1: SerialNumber: 0000:00:01.2544gitlab # [ 2.328698] SCSI subsystem initialized545gitlab # [ 2.329621] virtio_blk virtio4: 4/0/0 default/read/poll queues546gitlab # [ 2.331939] hub 1-0:1.0: USB hub found547gitlab # [ 2.332557] hub 1-0:1.0: 2 ports detected548gitlab # [ 2.336058] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)549gitlab # [ 2.345076] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12550gitlab # [ 2.350724] serio: i8042 KBD port at 0x60,0x64 irq 1551gitlab # [ 2.351712] serio: i8042 AUX port at 0x60,0x64 irq 12552gitlab # [ 2.359707] virtio_blk virtio5: 4/0/0 default/read/poll queues553gitlab # [ 2.370456] virtio_blk virtio5: [vdb] 11953328 512-byte logical blocks (6.12 GB/5.70 GiB)554gitlab # [ 2.255492] systemd[1]: Starting Virtual Console Setup...555gitlab # [ 2.262320] (udev-worker)[140]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.556gitlab # [ 2.265771] (udev-worker)[140]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.428845] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0558gitlab # [ 2.429647] scsi host0: ata_piix559gitlab # [ 2.275741] (udev-worker)[133]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.436603] scsi host1: ata_piix561gitlab # [ 2.437557] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0562gitlab # [ 2.438893] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0563gitlab # [ 2.286171] systemd[1]: Found device /dev/disk/by-label/nixos.564gitlab # [ 2.287520] systemd[1]: Reached target Initrd Root Device.565gitlab # [ 2.289457] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...566gitlab # [ 2.291193] systemd-vconsole-setup[146]: Configuration of first virtual console was skipped, ignoring remaining ones.567gitlab # [ 2.296948] systemd[1]: Finished Virtual Console Setup.568gitlab # [ 2.301341] systemd[1]: Found device /dev/disk/by-label/nix-store.569gitlab # [ 2.315163] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks570gitlab # [ 2.319470] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.571gitlab # [ 2.562923] usb 1-1: new full-speed USB device number 2 using uhci_hcd572gitlab # [ 2.603272] ata2: found unknown device (class 0)573gitlab # [ 2.606341] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100574gitlab # [ 2.611024] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5575gitlab # [ 2.667043] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray576gitlab # [ 2.696848] cdrom: Uniform CD-ROM driver Revision: 3.20577gitlab # [ 2.729956] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00578gitlab # [ 2.733356] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10579gitlab # [ 2.736314] usb 1-1: Product: QEMU USB Tablet580gitlab # [ 2.738243] usb 1-1: Manufacturer: QEMU581gitlab # [ 2.739942] usb 1-1: SerialNumber: 28754-0000:00:01.2-1582gitlab # [ 2.773061] hid: raw HID events driver (C) Jiri Kosina583gitlab # [ 2.786305] usbcore: registered new interface driver usbhid584gitlab # [ 2.788567] usbhid: USB HID core driver585gitlab # [ 2.798924] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2586gitlab # [ 2.803284] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0587gitlab # [ 2.912756] systemd[1]: Mounting /sysroot...588gitlab # [ 3.229850] EXT4-fs (vda): mounted filesystem b77f10ef-2706-42e3-99f4-93734be5a909 r/w with ordered data mode. Quota mode: none.589gitlab # [ 3.081719] systemd[1]: Mounted /sysroot.590gitlab # [ 3.083167] systemd[1]: Reached target Initrd Root File System.591gitlab # [ 3.087485] systemd[1]: Mounting /sysroot/nix/.ro-store...592gitlab # [ 3.089579] systemd[1]: Mounting /sysroot/nix/.rw-store...593gitlab # [ 3.093392] systemd[1]: Mounting /sysroot/run...594gitlab # [ 3.095076] systemd[1]: Mounting /sysroot/tmp/shared...595gitlab # [ 3.115263] systemd[1]: Mounting /sysroot/tmp/xchg...596gitlab # [ 3.120211] systemd[1]: Starting Mountpoints Configured in the Real Root...597gitlab # [ 3.124728] systemd[1]: Mounted /sysroot/run.598gitlab # [ 3.131313] systemd[1]: Mounted /sysroot/nix/.rw-store.599gitlab # [ 3.135223] systemd[1]: Starting rw-sysroot-nix-store.service...600gitlab # [ 3.297882] erofs (device vdb): mounted with root inode @ nid 128.601gitlab # [ 3.145213] systemd[1]: Mounted /sysroot/nix/.ro-store.602gitlab # [ 3.302654] 9p: Installing v9fs 9p2000 file system support603gitlab # [ 3.148488] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.604gitlab # [ 3.152563] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...605gitlab # [ 3.154674] systemd[1]: Reloading...606gitlab # [ 3.227425] systemd[1]: Reloading finished in 73 ms.607gitlab # [ 3.250881] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...608gitlab # [ 3.254431] systemd[1]: Mounted /sysroot/tmp/shared.609gitlab # [ 3.256661] systemd[1]: Mounted /sysroot/tmp/xchg.610gitlab # [ 3.258859] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.611gitlab # [ 3.262082] systemd[1]: Finished rw-sysroot-nix-store.service.612gitlab # [ 3.264381] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...613gitlab # [ 3.267387] systemd[1]: Starting rw-sysroot-nix-store.service...614gitlab # [ 3.269799] systemd[1]: initrd-parse-etc.service: Deactivated successfully.615gitlab # [ 3.272545] systemd[1]: Finished Mountpoints Configured in the Real Root.616gitlab # [ 3.275138] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.617gitlab # [ 3.286540] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.618gitlab # [ 3.289539] systemd[1]: Finished rw-sysroot-nix-store.service.619gitlab # [ 3.913304] systemd[1]: Mounting /sysroot/nix/store...620gitlab # [ 3.964056] systemd[1]: Mounted /sysroot/nix/store.621gitlab # [ 3.966175] systemd[1]: Reached target Initrd File Systems.622gitlab # [ 3.968487] systemd[1]: Starting Find NixOS closure...623gitlab # [ 3.970495] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...624gitlab # [ 4.006863] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.625gitlab # [ 4.010372] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.626gitlab # [ 4.031997] systemd[1]: Finished Find NixOS closure.627gitlab # [ 4.034076] systemd[1]: Reached target Initrd Default Target.628gitlab # [ 4.036222] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...629gitlab # [ 4.068173] systemd[1]: Stopped target Initrd Default Target.630gitlab # [ 4.070420] systemd[1]: Stopped target Basic System.631gitlab # [ 4.072358] systemd[1]: Stopped target Initrd Root Device.632gitlab # [ 4.074304] systemd[1]: Stopped target Path Units.633gitlab # [ 4.076089] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.634gitlab # [ 4.078612] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.635gitlab # [ 4.081338] systemd[1]: Stopped target Slice Units.636gitlab # [ 4.083722] systemd[1]: Stopped target Socket Units.637gitlab # [ 4.088419] systemd[1]: Stopped target System Initialization.638gitlab # [ 4.090882] systemd[1]: Stopped target Swaps.639gitlab # [ 4.094667] systemd[1]: Stopped target Timer Units.640gitlab # [ 4.097742] systemd[1]: dbus.socket: Deactivated successfully.641gitlab # [ 4.100456] systemd[1]: Closed D-Bus System Message Bus Socket.642gitlab # [ 4.102671] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.643gitlab # [ 4.105275] systemd[1]: Stopped Find NixOS closure.644gitlab # [ 4.106965] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio645gitlab # [ 4.110728] systemd[1]: Starting rw-sysroot-nix-store.service...646gitlab # [ 4.112628] systemd[1]: systemd-sysctl.service: Deactivated successfully.647gitlab # [ 4.114631] systemd[1]: Stopped Apply Kernel Variables.648gitlab # [ 4.116281] systemd[1]: systemd-modules-load.service: Deactivated successfully.649gitlab # [ 4.118481] systemd[1]: Stopped Load Kernel Modules.650gitlab # [ 4.120107] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.651gitlab # [ 4.122406] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.652gitlab # [ 4.124735] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.653gitlab # [ 4.126936] systemd[1]: Stopped Create System Files and Directories.654gitlab # [ 4.128841] systemd[1]: Stopped target Local File Systems.655gitlab # [ 4.130524] systemd[1]: Stopped target Preparation for Local File Systems.656gitlab # [ 4.132530] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.657gitlab # [ 4.134686] systemd[1]: Stopped Coldplug All udev Devices.658gitlab # [ 4.136332] systemd[1]: Stopping Rule-based Manager for Device Events and Files...659gitlab # [ 4.138485] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.660gitlab # [ 4.139671] systemd[1]: Stopped Virtual Console Setup.661gitlab # [ 4.140586] systemd[1]: initrd-cleanup.service: Deactivated successfully.662gitlab # [ 4.141700] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.663gitlab # [ 4.142782] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.664gitlab # [ 4.143953] systemd[1]: Finished rw-sysroot-nix-store.service.665gitlab # [ 4.145057] systemd[1]: systemd-udevd.service: Deactivated successfully.666gitlab # [ 4.146196] systemd[1]: Stopped Rule-based Manager for Device Events and Files.667gitlab # [ 4.147437] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.668gitlab # [ 4.148880] systemd[1]: Closed udev Control Socket.669gitlab # [ 4.149774] systemd[1]: Starting Cleanup udev Database...670gitlab # [ 4.150725] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.671gitlab # [ 4.151908] systemd[1]: Stopped Create Static Device Nodes in /dev.672gitlab # [ 4.152840] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.673gitlab # [ 4.154089] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.674gitlab # [ 4.155127] systemd[1]: kmod-static-nodes.service: Deactivated successfully.675gitlab # [ 4.156130] systemd[1]: Stopped Create List of Static Device Nodes.676gitlab # [ 4.170345] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.677gitlab # [ 4.171655] systemd[1]: Finished Cleanup udev Database.678gitlab # [ 4.172601] systemd[1]: Reached target Switch Root.679gitlab # [ 4.174540] systemd[1]: Starting NixOS Activation...680gitlab # [ 4.313122] initrd-nixos-activation-start[229]: booting system configuration /nix/store/si4dwijnqixhw65ahaw8pallzhwym9p2-nixos-system-gitlab-test681gitlab # [ 4.362394] initrd-nixos-activation-start[229]: running activation script...682gitlab # [ 4.624351] initrd-nixos-activation-start[252]: setting up /etc...683gitlab # [ 4.711058] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.684gitlab # [ 4.712570] systemd[1]: Finished NixOS Activation.685gitlab # [ 4.715898] systemd[1]: Starting Switch Root...686gitlab # [ 4.748265] systemd[1]: Switching root.687gitlab # [ 4.978193] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).688gitlab # [ 5.095712] NET: Registered PF_VSOCK protocol family689gitlab # [ 5.472557] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)690gitlab # [ 5.482841] systemd[1]: Detected virtualization kvm.691gitlab # [ 5.484706] systemd[1]: Detected architecture x86-64.692gitlab # [ 5.486695] systemd[1]: Detected first boot.693gitlab # [ 5.489287] systemd[1]: Initializing machine ID from random generator.694gitlab # [ 5.638475] systemd[1]: bpf-restrict-fs: LSM BPF program attached695gitlab # [ 5.733138] systemd[1]: Applying preset policy.696gitlab # [ 5.881300] systemd[1]: Populated /etc with preset unit settings.697gitlab # [ 6.000097] systemd[1]: initrd-switch-root.service: Deactivated successfully.698gitlab # [ 6.001788] systemd[1]: Stopped initrd-switch-root.service.699gitlab # [ 6.004117] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.700gitlab # [ 6.006521] systemd[1]: Created slice Slice /system/getty.701gitlab # [ 6.008167] systemd[1]: Created slice GitLab DevOps Platform Slice.702gitlab # [ 6.010225] systemd[1]: Created slice User and Session Slice.703gitlab # [ 6.011317] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.704gitlab # [ 6.012810] systemd[1]: Started Forward Password Requests to Wall Directory Watch.705gitlab # [ 6.014208] systemd[1]: Expecting device /dev/hvc0...706gitlab # [ 6.015063] systemd[1]: Expecting device /dev/ttyS0...707gitlab # [ 6.015944] systemd[1]: Reached target Local Encrypted Volumes.708gitlab # [ 6.016931] systemd[1]: Stopped target initrd-fs.target.709gitlab # [ 6.017803] systemd[1]: Stopped target initrd-root-fs.target.710gitlab # [ 6.018803] systemd[1]: Stopped target initrd-switch-root.target.711gitlab # [ 6.019835] systemd[1]: Reached target Virtual Machines and Containers.712gitlab # [ 6.020973] systemd[1]: Reached target Path Units.713gitlab # [ 6.021792] systemd[1]: Reached target Remote File Systems.714gitlab # [ 6.022698] systemd[1]: Reached target Slice Units.715gitlab # [ 6.023649] systemd[1]: Reached target Swaps.716gitlab # [ 6.025301] systemd[1]: Listening on Query the User Interactively for a Password.717gitlab # [ 6.027648] systemd[1]: Listening on Process Core Dump Socket.718gitlab # [ 6.029323] systemd[1]: Listening on Credential Encryption/Decryption.719gitlab # [ 6.031157] systemd[1]: Listening on Factory Reset Management.720gitlab # [ 6.032290] systemd[1]: Listening on Hostname Service Socket.721gitlab # [ 6.035011] systemd[1]: Starting Journal Log Access Socket...722gitlab # [ 6.036686] systemd[1]: Listening on Journal Audit Socket.723gitlab # [ 6.038950] systemd[1]: Listening on Console Output Muting Service Socket.724gitlab # [ 6.040294] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.725gitlab # [ 6.041719] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os726gitlab # [ 6.043366] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki727gitlab # [ 6.046237] systemd[1]: Listening on Disk Repartitioning Service Socket.728gitlab # [ 6.047435] systemd[1]: Listening on udev Control Socket.729gitlab # [ 6.048447] systemd[1]: Listening on udev Varlink Socket.730gitlab # [ 6.051846] systemd[1]: Mounting Huge Pages File System...731gitlab # [ 6.054035] systemd[1]: Mounting POSIX Message Queue File System...732gitlab # [ 6.056317] systemd[1]: Mounting Kernel Debug File System...733gitlab # [ 6.059689] systemd[1]: Mounting Kernel Trace File System...734gitlab # [ 6.066571] systemd[1]: Starting Create List of Static Device Nodes...735gitlab # [ 6.067686] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio736gitlab # [ 6.075776] systemd[1]: Starting Load Kernel Module configfs...737gitlab # [ 6.079839] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm738gitlab # [ 6.084868] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore739gitlab # [ 6.099256] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse740gitlab # [ 6.103933] systemd[1]: Mounting FUSE Control File System...741gitlab # [ 6.106281] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67742gitlab # [ 6.119186] systemd[1]: Starting Journal Service...743gitlab # [ 6.123007] systemd[1]: Starting Load Kernel Modules...744gitlab # [ 6.135094] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...745gitlab # [ 6.140912] systemd[1]: Starting Remount Root and Kernel File Systems...746gitlab # [ 6.143185] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os747gitlab # [ 6.151923] systemd[1]: Starting Coldplug All udev Devices...748gitlab # [ 6.159005] loop: module loaded749gitlab # [ 6.160244] systemd[1]: Listening on Journal Log Access Socket.750gitlab # [ 6.161982] systemd[1]: Mounted Huge Pages File System.751gitlab # [ 6.163571] systemd[1]: Mounted POSIX Message Queue File System.752gitlab # [ 6.164230] systemd-journald[322]: Collecting audit messages is enabled.753gitlab # [ 6.164790] systemd[1]: Mounted Kernel Debug File System.754gitlab # [ 6.167020] systemd[1]: Mounted Kernel Trace File System.755gitlab # [ 6.167226] EXT4-fs (vda): re-mounted b77f10ef-2706-42e3-99f4-93734be5a909.756gitlab # [ 6.167929] systemd[1]: Finished Create List of Static Device Nodes.757gitlab # [ 6.171003] systemd[1]: modprobe@configfs.service: Deactivated successfully.758gitlab # [ 6.172516] systemd[1]: Finished Load Kernel Module configfs.759gitlab # [ 6.173814] systemd[1]: Mounted FUSE Control File System.760gitlab # [ 6.175226] systemd[1]: Finished Load Kernel Modules.761gitlab # [ 6.176588] systemd[1]: Finished Remount Root and Kernel File Systems.762gitlab # [ 6.178236] systemd[1]: Listening on Disk Image Download Service Socket.763gitlab # [ 6.023465] systemd[1]: Queued start job for default target Multi-User System.764gitlab # [ 6.024825] systemd[1]: Unnecessary job was removed for /dev/vdb.765gitlab # [ 6.181373] systemd[1]: Mounting Kernel Configuration File System...766gitlab # [ 6.026194] systemd[1]: systemd-journald.service: Deactivated successfully.767gitlab # [ 6.027967] systemd-modules-load[323]: Using 3 probe threads768gitlab # [ 6.029118] systemd-modules-load[323]: Inserted module 'loop'[ 6.185203] systemd[1]: Starting Firewall...769gitlab # 770gitlab # [ 6.030730] systemd-modules-load[323]: Inserted module 'tls'771gitlab # [ 6.186828] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore772gitlab # [ 6.193824] systemd[1]: Starting Load/Save OS Random Seed...773gitlab # [ 6.039451] systemd-oomd[325]: No swap; memory pressure usage will be degraded774gitlab # [ 6.195941] systemd[1]: Starting Apply Kernel Variables...775gitlab # [ 6.200840] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...776gitlab # [ 6.202393] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os777gitlab # [ 6.204961] systemd[1]: Started Journal Service.778gitlab # [ 6.052726] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.779gitlab # [ 6.055563] systemd[1]: Mounted Kernel Configuration File System.780gitlab # [ 6.064074] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 6.065915] systemd[1]: Reached target First Boot Complete.782gitlab # [ 6.068593] systemd[1]: Starting Flush Journal to Persistent Storage...783gitlab # [ 6.070884] systemd[1]: Finished Apply Kernel Variables.784gitlab # [ 6.074178] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.785gitlab # [ 6.076842] systemd[1]: Starting Create Static Device Nodes in /dev...786gitlab # [ 6.239588] systemd-journald[322]: Received client request to flush runtime journal.787gitlab # [ 6.120311] systemd[1]: Finished Create Static Device Nodes in /dev.788gitlab # [ 6.121620] systemd[1]: Reached target Preparation for Local File Systems.789gitlab # [ 6.122842] systemd[1]: Starting Rule-based Manager for Device Events and Files...790gitlab # [ 6.123986] systemd[1]: Finished Flush Journal to Persistent Storage.791gitlab # [ 6.127547] systemd-udevd[360]: Using default interface naming scheme 'v261'.792gitlab # [ 6.152558] systemd[1]: Finished Coldplug All udev Devices.793gitlab # [ 6.158752] systemd[1]: Started Rule-based Manager for Device Events and Files.794gitlab # [ 6.233932] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse795gitlab # [ 6.261484] (udev-worker)[440]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.266910] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.797gitlab # [ 6.271949] (udev-worker)[429]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.798gitlab # [ 6.274347] (udev-worker)[429]: Network interface NamePolicy= disabled on kernel command line.799gitlab # [ 6.279439] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.800gitlab # [ 6.285421] systemd[1]: Condition check resulted in Virtio network device being skipped.801gitlab # [ 6.286648] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore802gitlab # [ 6.288278] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67803gitlab # [ 6.290772] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore804gitlab # [ 6.292532] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os805gitlab # [ 6.294117] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os806gitlab # [ 6.310715] systemd[1]: Finished Firewall.807gitlab # [ 6.489559] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3808gitlab # [ 6.489976] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console809gitlab # [ 6.508166] Console: switching to colour dummy device 80x25810gitlab # [ 6.508833] ACPI: button: Power Button [PWRF]811gitlab # [ 6.509633] [drm] Found bochs VGA, ID 0xb0c5.812gitlab # [ 6.509635] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.813gitlab # [ 6.511300] mousedev: PS/2 mouse device common for all mice814gitlab # [ 6.512800] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic815gitlab # [ 6.513602] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0816gitlab # [ 6.529099] Console: switching to colour frame buffer device 160x50817gitlab # [ 6.530663] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device818gitlab # [ 6.531629] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0819gitlab # [ 6.532757] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD820gitlab # [ 6.546962] rtc_cmos 00:05: RTC can wake from S4821gitlab # [ 6.557973] rtc_cmos 00:05: registered as rtc0822gitlab # [ 6.558582] rtc_cmos 00:05: setting system clock to 2026-10-26T21:31:12 UTC (1793050272)823gitlab # [ 6.561801] Floppy drive(s): fd0 is 2.88M AMI BIOS824gitlab # [ 6.562927] parport_pc 00:03: reported by Plug and Play ACPI825gitlab # [ 6.563802] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs826gitlab # [ 6.566958] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]827gitlab # [ 6.568232] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4828gitlab # [ 6.575885] FDC 0 is a S82078B829gitlab # [ 6.587479] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6830gitlab # [ 6.599307] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5831gitlab # [ 6.484085] systemd[1]: Starting Virtual Console Setup...832gitlab # [ 6.660818] ppdev: user-space parallel port driver833gitlab # [ 6.514550] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.834gitlab # [ 6.517553] systemd[1]: Stopped Virtual Console Setup.835gitlab # [ 6.522201] systemd[1]: Starting Virtual Console Setup...836gitlab # [ 6.575609] systemd-vconsole-setup[496]: Configuration of first virtual console was skipped, ignoring remaining ones.837gitlab # [ 6.579052] systemd[1]: Finished Virtual Console Setup.838gitlab # [ 6.778296] kvm_amd: TSC scaling supported839gitlab # [ 6.778892] kvm_amd: Nested Virtualization enabled840gitlab # [ 6.779376] kvm_amd: Nested Paging enabled841gitlab # [ 6.779938] kvm_amd: LBR virtualization supported842gitlab # [ 6.780424] kvm_amd: Virtual VMLOAD VMSAVE supported843gitlab # [ 6.781043] kvm_amd: Virtual GIF supported844gitlab # [ 6.781466] kvm_amd: Virtual NMI enabled845gitlab # [ 6.815092] EDAC MC: Ver: 3.0.0846gitlab # [ 6.849332] systemd[1]: Mounting /run/wrappers...847gitlab # [ 6.872519] systemd[1]: Mounted /run/wrappers.848gitlab # [ 6.874593] systemd[1]: Reached target Local File Systems.849gitlab # [ 6.876855] systemd[1]: Listening on Boot Loader Control Service Socket.850gitlab # [ 6.879485] systemd[1]: Starting register-nix-paths.service...851gitlab # [ 6.881773] systemd[1]: Starting Create SUID/SGID Wrappers...852gitlab # [ 6.883998] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.853gitlab # [ 6.887359] systemd[1]: Starting Save Transient machine-id to Disk...854gitlab # [ 6.895351] systemd[1]: Starting Create System Files and Directories...855gitlab # [ 6.922478] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.856gitlab # [ 6.925316] systemd[1]: Finished Save Transient machine-id to Disk.857gitlab # [ 6.944906] systemd[1]: Finished Create System Files and Directories.858gitlab # [ 6.949396] systemd[1]: Starting Rebuild Journal Catalog...859gitlab # [ 6.958285] systemd[1]: Starting Record System Boot/Shutdown in UTMP...860gitlab # [ 6.985057] systemd[1]: Finished Record System Boot/Shutdown in UTMP.861gitlab # [ 6.988386] systemd[1]: Finished Rebuild Journal Catalog.862gitlab # [ 6.990624] systemd[1]: Starting Update is Completed...863gitlab # [ 7.003936] systemd[1]: Finished Update is Completed.864gitlab # [ 7.062207] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.865gitlab # [ 7.064296] systemd[1]: Finished Create SUID/SGID Wrappers.866gitlab # [ 7.298694] systemd[1]: Finished register-nix-paths.service.867gitlab # [ 7.301075] systemd[1]: Reached target System Initialization.868gitlab # [ 7.303240] systemd[1]: Started Discard unused filesystem blocks once a week.869gitlab # [ 7.305738] systemd[1]: Started logrotate.timer.870gitlab # [ 7.307550] systemd[1]: Started Daily Cleanup of Temporary Directories.871gitlab # [ 7.309931] systemd[1]: Reached target Timer Units.872gitlab # [ 7.311881] systemd[1]: Listening on D-Bus System Message Bus Socket.873gitlab # [ 7.314292] systemd[1]: Listening on Nix Daemon Socket.874gitlab # [ 7.316331] systemd[1]: Starting nixbot CI service socket...875gitlab # [ 7.318458] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.876gitlab # [ 7.321457] systemd[1]: Starting D-Bus System Message Bus...877gitlab # [ 7.330331] systemd[1]: Listening on nixbot CI service socket.878gitlab # [ 7.332527] systemd[1]: Reached target Socket Units.879gitlab # [ 7.361512] dbus-broker-launch[578]: Looking up NSS user entry for 'systemd-timesync'...880gitlab # [ 7.365211] dbus-broker-launch[578]: NSS returned no entry for 'systemd-timesync'881gitlab # [ 7.367809] dbus-broker-launch[578]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"882gitlab # [ 7.373414] systemd[1]: Started D-Bus System Message Bus.883gitlab # [ 7.386543] dbus-broker-launch[578]: Ready884gitlab # [ 7.389292] systemd[1]: Reached target Basic System.885gitlab # [ 7.392292] systemd[1]: Started backdoor.service.886gitlab # [ 7.395522] systemd[1]: Starting gitlab-config.service...887gitlab # [ 7.397939] systemd[1]: Starting Import lastlog data into lastlog2 database...888gitlab # [ 7.401104] systemd[1]: Starting Logrotate configuration check...889gitlab # [ 7.403644] systemd[1]: Starting Name Service Cache Daemon (nsncd)...890gitlab # [ 7.412807] systemd[1]: Starting Post-Boot Actions...891gitlab # [ 7.418199] systemd[1]: Started Reset console on configuration changes.892gitlab # [ 7.425120] systemd[1]: Starting resolvconf update...893gitlab # [ 7.434634] logrotate[583]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.894gitlab # [ 7.439295] logrotate[583]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf895gitlab # [ 7.442389] logrotate[583]: note: 'monthly' overrides previously specified 'weekly'896gitlab # [ 7.444862] logrotate[583]: Reading state from file: /var/lib/logrotate.status897gitlab # [ 7.446826] logrotate[583]: state file /var/lib/logrotate.status does not exist898gitlab # [ 7.449288] logrotate[583]: Allocating hash table for state file, size 64 entries899gitlab # connecting to host...900gitlab # [ 7.451553] logrotate[583]: Handling 4 logs901gitlab # [ 7.452630] logrotate[583]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed902gitlab # [ 7.455809] logrotate[583]: considering log /var/log/btmp903gitlab # [ 7.456232] logrotate[583]: Creating new state904gitlab # [ 7.457231] logrotate[583]: Now: 2026-10-26 21:31905gitlab # [ 7.457888] logrotate[583]: Last rotated at 2026-10-26 21:00906gitlab # [ 7.459271] logrotate[583]: log does not need rotating (log has already been rotated)907gitlab # [ 7.459906] logrotate[583]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed908gitlab # [ 7.460967] logrotate[583]: considering log /var/log/wtmp909gitlab # [ 7.461928] logrotate[583]: Creating new state910gitlab # [ 7.462898] logrotate[583]: Now: 2026-10-26 21:31911gitlab # [ 7.463583] logrotate[583]: Last rotated at 2026-10-26 21:00912gitlab # [ 7.464125] logrotate[583]: log does not need rotating (log has already been rotated)913gitlab # [ 7.464621] logrotate[583]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed914gitlab # [ 7.465161] logrotate[583]: switching euid from 0 to 165 and egid from 0 to 165 (pid 583)915gitlab # [ 7.465661] logrotate[583]: considering log /var/gitlab/state/log/*.log916gitlab # [ 7.466212] logrotate[583]: log /var/gitlab/state/log/*.log does not exist -- skipping917gitlab # [ 7.466680] logrotate[583]: Creating new state918gitlab # [ 7.467204] logrotate[583]: switching euid from 165 to 0 and egid from 165 to 0 (pid 583)919gitlab # [ 7.467717] logrotate[583]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed920gitlab # [ 7.468412] logrotate[583]: switching euid from 0 to 60 and egid from 0 to 60 (pid 583)921gitlab # [ 7.468904] logrotate[583]: considering log /var/log/nginx/*.log922gitlab # [ 7.469593] logrotate[583]: log /var/log/nginx/*.log does not exist -- skipping923gitlab # [ 7.470117] logrotate[583]: Creating new state924gitlab # [ 7.470603] logrotate[583]: not running postrotate script, since no logs were rotated925gitlab # [ 7.471119] logrotate[583]: switching euid from 60 to 0 and egid from 60 to 0 (pid 583)926gitlab # [ 7.471801] systemd[1]: Finished Logrotate configuration check.927gitlab # [ 7.472775] nsncd[584]: Oct 26 21:31:13.548 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"928gitlab: Guest shell says: b'Spawning backdoor root shell...\n'929gitlab # [ 7.489298] systemd[1]: Finished Post-Boot Actions.930gitlab: connected to guest root shell931gitlab # [ 7.490572] systemd[1]: Started Name Service Cache Daemon (nsncd).932gitlab: (connecting took 8.16 seconds)933gitlab # [ 7.493561] systemd[1]: Finished Import lastlog data into lastlog2 database.934gitlab: (finished: waiting for the VM to finish booting, in 8.16 seconds)935gitlab # [ 7.499207] systemd[1]: Reached target Host and Network Name Lookups.936gitlab # [ 7.499522] systemd[1]: Reached target User and Group Name Lookups.937gitlab # [ 7.502626] systemd[1]: Starting User Login Management...938gitlab # [ 7.525329] systemd[1]: Stopped target Host and Network Name Lookups.939gitlab # [ 7.527241] systemd[1]: Stopping Host and Network Name Lookups...940gitlab # [ 7.527602] systemd[1]: Stopped target User and Group Name Lookups.941gitlab # [ 7.528220] systemd[1]: Stopping User and Group Name Lookups...942gitlab # [ 7.528701] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...943gitlab # [ 7.531377] systemd[1]: nscd.service: Deactivated successfully.944gitlab # [ 7.532627] systemd[1]: Stopped Name Service Cache Daemon (nsncd).945gitlab # [ 7.533054] systemd[1]: nscd.service: Consumed 50ms CPU time over 129ms wall clock time, 7.5M memory peak, 5.5M read from disk.946gitlab # [ 7.536740] systemd[1]: Starting Name Service Cache Daemon (nsncd)...947gitlab # [ 7.547297] systemd-logind[635]: New seat seat0.948gitlab # [ 7.552133] systemd-logind[635]: Watching system buttons on /dev/input/event2 (Power Button)949gitlab # [ 7.552867] systemd-logind[635]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)950gitlab # [ 7.553656] systemd-logind[635]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)951gitlab # [ 7.554455] systemd[1]: Started User Login Management.952gitlab # [ 7.557818] systemd[1]: Starting linger-users.service...953gitlab # [ 7.561901] systemd[1]: Finished resolvconf update.954gitlab # [ 7.562291] systemd[1]: Reached target Preparation for Network.955gitlab # [ 7.566287] nsncd[673]: Oct 26 21:31:13.662 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"956gitlab # [ 7.569108] systemd[1]: Starting DHCP Client...957gitlab # [ 7.572205] systemd[1]: Starting Address configuration of eth1...958gitlab # [ 7.575248] systemd[1]: Starting Extra networking commands....959gitlab # [ 7.576920] systemd[1]: Started Name Service Cache Daemon (nsncd).960gitlab # [ 7.578822] systemd[1]: Reached target Host and Network Name Lookups.961gitlab # [ 7.580094] systemd[1]: Reached target User and Group Name Lookups.962gitlab # [ 7.581032] systemd[1]: linger-users.service: Deactivated successfully.963gitlab # [ 7.582516] systemd[1]: Finished linger-users.service.964gitlab # [ 7.606607] network-addresses-eth1-start[700]: adding address 192.168.1.1/24... done965gitlab # [ 7.608752] network-addresses-eth1-start[700]: adding address 2001:db8:1::1/64... done966gitlab # [ 7.614204] systemd[1]: Finished Address configuration of eth1.967gitlab # [ 7.643033] dhcpcd[711]: dhcpcd-10.3.2 starting968gitlab # [ 7.645132] dhcpcd[765]: dev: loaded udev969gitlab # [ 7.646421] systemd[1]: Finished Extra networking commands..970gitlab # [ 7.648174] systemd[1]: Reached target Network.971gitlab # [ 7.649054] systemd[1]: Starting gitlab-workhorse.service...972gitlab # [ 7.805905] 8021q: 802.1Q VLAN Support v1.8973gitlab # [ 7.806429] 8021q: adding VLAN 0 to HW filter on device eth1974gitlab # [ 7.652820] systemd[1]: Starting Nginx Web Server...975gitlab # [ 7.655241] systemd[1]: Starting PostgreSQL Server...976gitlab # [ 7.657829] systemd[1]: Starting Redis Server - redis-gitlab...977gitlab # [ 7.660048] systemd[1]: Starting Permit User Sessions...978gitlab # [ 7.673993] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.979gitlab # [ 7.684242] systemd[1]: Finished Permit User Sessions.980gitlab # [ 7.698254] systemd[1]: Started Getty on tty1.981gitlab # [ 7.699749] systemd[1]: Reached target Login Prompts.982gitlab # [ 7.903907] cfg80211: Loading compiled-in X.509 certificates for regulatory database983gitlab # [ 7.910394] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'984gitlab # [ 7.911783] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'985gitlab # [ 7.913825] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2986gitlab # [ 7.915231] cfg80211: failed to load regulatory.db987gitlab # [ 7.776058] nginx-pre-start[789]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok988gitlab # [ 7.776278] nginx-pre-start[789]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful989gitlab # [ 7.784437] systemd[1]: Started Nginx Web Server.990gitlab # [ 7.954960] 8021q: adding VLAN 0 to HW filter on device eth0991gitlab # [ 7.802502] dhcpcd[765]: eth0: waiting for carrier992gitlab # [ 7.802967] dhcpcd[765]: eth0: carrier acquired993gitlab # [ 7.810288] dhcpcd[765]: DUID 00:01:00:01:32:72:83:21:52:54:00:12:34:56994gitlab # [ 7.810675] dhcpcd[765]: eth0: IAID 00:12:34:56995gitlab # [ 7.811325] dhcpcd[765]: eth0: adding address fe80::5054:ff:fe12:3456996gitlab # [ 7.818613] redis-server[791]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.997gitlab # [ 7.819170] redis-server[791]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo998gitlab # [ 7.819917] redis-server[791]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=791, just started999gitlab # [ 7.820652] redis-server[791]: Configuration loaded1000gitlab # [ 7.821232] redis[791]: monotonic clock: POSIX clock_gettime1001gitlab # [ 7.822814] redis[791]: Running mode=standalone, port=0.1002gitlab # [ 7.823967] redis[791]: Server initialized1003gitlab # [ 7.825157] redis[791]: Ready to accept connections unix1004gitlab # [ 7.825794] systemd[1]: Started Redis Server - redis-gitlab.1005gitlab # [ 7.826406] redis[791]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1006gitlab # [ 7.841187] postgresql-pre-start[799]: The files belonging to this database system will be owned by user "postgres".1007gitlab # [ 7.841623] postgresql-pre-start[799]: This user must also own the server process.1008gitlab # [ 7.844142] postgresql-pre-start[799]: The database cluster will be initialized with locale "en_US.UTF-8".1009gitlab # [ 7.844616] postgresql-pre-start[799]: The default database encoding has accordingly been set to "UTF8".1010gitlab # [ 7.845123] postgresql-pre-start[799]: The default text search configuration will be set to "english".1011gitlab # [ 7.845646] postgresql-pre-start[799]: Data page checksums are enabled.1012gitlab # [ 7.846218] postgresql-pre-start[799]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1013gitlab # [ 7.846824] postgresql-pre-start[799]: creating subdirectories ... ok1014gitlab # [ 7.847770] postgresql-pre-start[799]: selecting dynamic shared memory implementation ... posix1015gitlab # [ 7.887757] postgresql-pre-start[799]: selecting default "max_connections" ... 1001016gitlab # [ 7.937933] postgresql-pre-start[799]: selecting default "shared_buffers" ... 128MB1017gitlab # [ 8.118874] systemd[1]: Started gitlab-workhorse.service.1018gitlab # [ 8.342929] postgresql-pre-start[799]: selecting default time zone ... UTC1019gitlab # [ 8.345493] postgresql-pre-start[799]: creating configuration files ... ok1020gitlab # [ 8.350938] gitlab-workhorse[826]: time="2026-10-26T21:31:14Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41021gitlab # [ 8.351622] gitlab-workhorse[826]: time="2026-10-26T21:31:14Z" level=info msg="Using redis/go-redis"1022gitlab # [ 8.352689] gitlab-workhorse[826]: time="2026-10-26T21:31:14Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1023gitlab # [ 8.517727] postgresql-pre-start[799]: running bootstrap script ... ok1024gitlab # [ 8.986684] dhcpcd[765]: eth0: soliciting a DHCP lease1025gitlab # [ 8.987958] postgresql-pre-start[799]: performing post-bootstrap initialization ... ok1026gitlab # [ 9.148204] NET: Registered PF_PACKET protocol family1027gitlab # [ 9.000072] dhcpcd[765]: eth0: offered 10.0.2.15 from 10.0.2.21028gitlab # [ 9.005214] dhcpcd[765]: eth0: probing address 10.0.2.15/241029gitlab # [ 9.235346] postgresql-pre-start[799]: syncing data to disk ... ok1030gitlab # [ 9.237757] postgresql-pre-start[799]: initdb: warning: enabling "trust" authentication for local connections1031gitlab # [ 9.241176] postgresql-pre-start[799]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1032gitlab # [ 9.246393] postgresql-pre-start[799]: Success. You can now start the database server using:1033gitlab # [ 9.249320] postgresql-pre-start[799]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1034gitlab # [ 9.334135] postgres[853]: [853] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1035gitlab # [ 9.338564] postgres[853]: [853] LOG: listening on IPv6 address "::1", port 54321036gitlab # [ 9.341449] postgres[853]: [853] LOG: listening on IPv4 address "127.0.0.1", port 54321037gitlab # [ 9.344390] postgres[853]: [853] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1038gitlab # [ 9.353535] postgres[862]: [862] LOG: database system was shut down at 2026-10-26 21:31:15 GMT1039gitlab # [ 9.363105] postgres[853]: [853] LOG: database system is ready to accept connections1040gitlab # [ 9.367705] systemd[1]: Started PostgreSQL Server.1041gitlab # [ 9.373344] systemd[1]: Starting PostgreSQL Setup Scripts...1042gitlab # [ 9.522454] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[870]: mkdir -p /var/gitlab/state/home/.ssh: OK1043gitlab # [ 9.526541] dhcpcd[765]: eth0: soliciting an IPv6 router1044gitlab # [ 9.526678] dhcpcd[765]: eth0: Router Advertisement from fe80::21045gitlab # [ 9.527572] dhcpcd[765]: eth0: adding address fec0::5054:ff:fe12:3456/641046gitlab # [ 9.528780] dhcpcd[765]: eth0: adding route to fec0::/641047gitlab # [ 9.529268] dhcpcd[765]: eth0: adding default route via fe80::21048gitlab # [ 9.536921] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[870]: chmod 700 /var/gitlab/state/home/.ssh: OK1049gitlab # [ 9.563666] postgresql-setup-start[878]: CREATE DATABASE1050gitlab # [ 9.584949] systemd[1]: Finished gitlab-config.service.1051gitlab # [ 9.590575] systemd[1]: Started gitaly.service.1052gitlab # [ 9.593273] postgresql-setup-start[898]: CREATE ROLE1053gitlab # [ 9.607410] postgresql-setup-start[906]: ALTER DATABASE1054gitlab # [ 9.624460] postgresql-setup-start[913]: CREATE ROLE1055gitlab # [ 9.627210] systemd[1]: Finished PostgreSQL Setup Scripts.1056gitlab # [ 9.627723] systemd[1]: Reached target PostgreSQL.1057gitlab # [ 9.629476] systemd[1]: Starting gitlab-db-config.service...1058gitlab # [ 9.631877] systemd[1]: Starting gitlab-postgresql.service...1059gitlab # [ 9.724971] gitlab-postgresql-start[923]: CREATE DATABASE1060gitlab # [ 9.764481] gitlab-postgresql-start[928]: CREATE EXTENSION1061gitlab # [ 9.847602] gitlab-postgresql-start[935]: CREATE EXTENSION1062gitlab # [ 9.852124] systemd[1]: Finished gitlab-postgresql.service.1063gitlab # [ 10.118798] gitaly[901]: time="2026-10-26T21:31:16.214Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9011064gitlab # [ 10.120425] gitaly[901]: time="2026-10-26T21:31:16.215Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9011065gitlab # [ 10.122254] gitaly[901]: time="2026-10-26T21:31:16.215Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9011066gitlab # [ 10.123048] gitaly[901]: time="2026-10-26T21:31:16.215Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9011067gitlab # [ 10.123911] gitaly[901]: time="2026-10-26T21:31:16.215Z" level=info msg="Starting Gitaly" pid=901 version=1068gitlab # [ 10.273879] gitaly[901]: time="2026-10-26T21:31:16.370Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=154 pid=9011069gitlab # [ 10.274245] gitaly[901]: time="2026-10-26T21:31:16.371Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9011070gitlab # [ 10.274926] gitaly[901]: time="2026-10-26T21:31:16.371Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9011071gitlab # [ 10.275635] gitaly[901]: time="2026-10-26T21:31:16.371Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-901/git-exec-211799472.d/git pid=9011072gitlab # [ 10.283828] gitaly[901]: time="2026-10-26T21:31:16.380Z" level=info msg="finished detecting git version" duration_ms=9 pid=9011073gitlab # [ 10.284160] gitaly[901]: time="2026-10-26T21:31:16.380Z" level=info msg="using Git version" pid=901 version=2.53.g1074gitlab # [ 10.287993] gitaly[901]: time="2026-10-26T21:31:16.385Z" level=info msg="clearing disk cache object folder" pid=901 storage=default1075gitlab # [ 10.290229] gitaly[901]: time="2026-10-26T21:31:16.387Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3144765932 pid=901 storage=default1076gitlab # [ 10.290598] gitaly[901]: time="2026-10-26T21:31:16.387Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3144765932 pid=901 storage=default1077gitlab # [ 10.291621] gitaly[901]: time="2026-10-26T21:31:16.388Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3144765932 clear_duration_ms=0 pid=901 storage=default1078gitlab # [ 10.299514] gitaly[901]: time="2026-10-26T21:31:16.396Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9011079gitlab # [ 10.299841] gitaly[901]: time="2026-10-26T21:31:16.396Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9011080gitlab # [ 10.349699] gitaly[901]: time="2026-10-26T21:31:16.446Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9011081gitlab # [ 10.349988] gitaly[901]: time="2026-10-26T21:31:16.446Z" level=info msg="counting repositories" pid=9011082gitlab # [ 10.350546] gitaly[901]: time="2026-10-26T21:31:16.446Z" level=info msg="finished tempdir cleaner walk" pid=901 storage=default time_ms=01083gitlab # [ 10.351230] gitaly[901]: time="2026-10-26T21:31:16.446Z" level=info msg="starting to count repositories" pid=901 storage_path=/var/gitlab/state/repositories1084gitlab # [ 10.351854] gitaly[901]: time="2026-10-26T21:31:16.447Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=901 storage_path=/var/gitlab/state/repositories1085gitlab # [ 10.352560] gitaly[901]: time="2026-10-26T21:31:16.447Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9011086gitlab # [ 10.353063] gitaly[901]: time="2026-10-26T21:31:16.446Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=901 schema=unix1087gitlab # [ 10.353564] gitaly[901]: time="2026-10-26T21:31:16.447Z" level=info msg="listening at address" address=/run/gitaly/gitaly-901/sock.d/intern pid=901 schema=unix1088gitlab # [ 10.367334] gitaly[901]: time="2026-10-26T21:31:16.464Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9011089gitlab # [ 10.367555] gitaly[901]: time="2026-10-26T21:31:16.464Z" level=info msg="Started Gitaly" duration_ms=249 pid=9011090gitlab # [ 10.368266] gitaly[901]: time="2026-10-26T21:31:16.465Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9011091gitlab # [ 10.372866] gitaly[901]: time="2026-10-26T21:31:16.469Z" level=info msg="maintenance: daily scheduled" pid=901 scheduled="2026-10-27 12:00:00 +0000 UTC"1092gitlab # [ 10.938166] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[918]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1093gitlab # [ 10.941335] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[918]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1094gitlab # [ 10.964466] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[918]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1095gitlab # [ 12.403146] gitaly[901]: time="2026-10-26T21:31:18.499Z" level=info msg="License database preloaded" duration_ms=2283 pid=9011096gitlab # [ 13.647269] dhcpcd[765]: eth0: leased 10.0.2.15 for 86400 seconds1097gitlab # [ 13.647686] dhcpcd[765]: eth0: adding route to 10.0.2.0/241098gitlab # [ 13.649670] dhcpcd[765]: eth0: adding default route via 10.0.2.21099gitlab # [ 13.771695] systemd[1]: Started DHCP Client.1100gitlab # [ 13.773925] systemd[1]: Reached target Network is Online.1101gitlab # [ 42.107522] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[918]: W, [2026-10-26T21:31:48.203804 #918] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1102gitlab # [ 44.133125] postgres[1319]: [1319] ERROR: relation "feature_gates" does not exist at character 5231103gitlab # [ 44.136293] postgres[1319]: [1319] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1104gitlab # [ 44.139396] postgres[1319]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1105gitlab # [ 44.142630] postgres[1319]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1106gitlab # [ 44.145611] postgres[1319]: attidentity AS identity,1107gitlab # [ 44.147768] postgres[1319]: attgenerated as attgenerated1108gitlab # [ 44.150056] postgres[1319]: FROM pg_attribute a1109gitlab # [ 44.151872] postgres[1319]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1110gitlab # [ 44.155078] postgres[1319]: LEFT JOIN pg_type t ON a.atttypid = t.oid1111gitlab # [ 44.157413] postgres[1319]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1112gitlab # [ 44.160913] postgres[1319]: WHERE a.attrelid = '"feature_gates"'::regclass1113gitlab # [ 44.163387] postgres[1319]: AND a.attnum > 0 AND NOT a.attisdropped1114gitlab # [ 44.165737] postgres[1319]: ORDER BY a.attnum1115gitlab # [ 44.167553] postgres[1319]:1116gitlab # [ 47.701699] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1361]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1117gitlab # [ 47.706720] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1361]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1118gitlab # [ 48.416497] gitlab-workhorse[826]: time="2026-10-26T21:31:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 58.425463] gitlab-workhorse[826]: time="2026-10-26T21:32:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1120gitlab # [ 64.302349] postgres[1445]: [1445] ERROR: relation "table_without_models" does not exist1121gitlab # [ 64.302710] postgres[1445]: [1445] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1122gitlab # [ 68.435307] gitlab-workhorse[826]: time="2026-10-26T21:32:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 76.087714] systemd[1]: Finished gitlab-db-config.service.1124gitlab # [ 76.094043] systemd[1]: Started gitlab-sidekiq.service.1125gitlab # [ 76.099436] systemd[1]: Starting gitlab.service...1126gitlab # [ 76.510187] bundle[1612]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1127gitlab # [ 76.516076] bundle[1612]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1128gitlab # [ 76.521686] bundle[1612]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1129gitlab # [ 78.444852] gitlab-workhorse[826]: time="2026-10-26T21:32:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1130gitlab # [ 79.384123] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-26T21:32:25.461Z","message":"Starting cluster with 1 processes"}1131gitlab # [ 81.250621] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.316Z","pid":1612,"message":"* Enabling systemd notification integration"}1132gitlab # [ 81.252524] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.347Z","pid":1612,"message":"Puma starting in cluster mode..."}1133gitlab # [ 81.253958] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.347Z","pid":1612,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1134gitlab # [ 81.255545] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.347Z","pid":1612,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1135gitlab # [ 81.257489] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.347Z","pid":1612,"message":"* Min threads: 0"}1136gitlab # [ 81.258771] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.347Z","pid":1612,"message":"* Max threads: 4"}1137gitlab # [ 81.260087] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.347Z","pid":1612,"message":"* Environment: production"}1138gitlab # [ 81.261485] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.347Z","pid":1612,"message":"* Master PID: 1612"}1139gitlab # [ 81.262779] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.347Z","pid":1612,"message":"* Workers: 2"}1140gitlab # [ 81.264038] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.347Z","pid":1612,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1141gitlab # [ 81.265655] bundle[1612]: {"timestamp":"2026-10-26T21:32:27.347Z","pid":1612,"message":"* Preloading application"}1142gitlab # [ 88.453102] gitlab-workhorse[826]: time="2026-10-26T21:32:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 98.464314] gitlab-workhorse[826]: time="2026-10-26T21:32:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 105.685314] bundle[1612]: W, [2026-10-26T21:32:51.781521 #1612] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1145gitlab # [ 107.435330] sidekiq-cluster[1642]: 2026-10-26T21:32:53.531Z pid=1642 tid=wjm INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1642, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>436637696}1146gitlab # [ 107.675499] sidekiq-cluster[1642]: W, [2026-10-26T21:32:53.772331 #1642] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 107.720950] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:53.817Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1148gitlab # [ 108.474479] gitlab-workhorse[826]: time="2026-10-26T21:32:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1149gitlab # [ 109.934615] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.030Z","message":"GitLab reliable fetch activated!"}1150gitlab # [ 109.935232] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.031Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1151gitlab # [ 109.967443] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.064Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1152gitlab # [ 109.972517] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.069Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1153gitlab # [ 109.978270] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.075Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1154gitlab # [ 109.983475] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.080Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1155gitlab # [ 109.989161] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.086Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1156gitlab # [ 109.994471] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.091Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1157gitlab # [ 109.999382] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.096Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1158gitlab # [ 110.003971] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.101Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1159gitlab # [ 110.008305] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.105Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1160gitlab # [ 110.012133] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.109Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1161gitlab # [ 110.016263] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.113Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1162gitlab # [ 110.020852] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.117Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1163gitlab # [ 110.024721] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.121Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1164gitlab # [ 110.028581] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.125Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1165gitlab # [ 110.032413] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.129Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1166gitlab # [ 110.036359] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.133Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1167gitlab # [ 110.040820] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.137Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1168gitlab # [ 110.045253] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.142Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1169gitlab # [ 110.049938] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.147Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1170gitlab # [ 110.054446] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.151Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1171gitlab # [ 110.059175] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.156Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1172gitlab # [ 110.063650] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.160Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1173gitlab # [ 110.069162] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.166Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1174gitlab # [ 110.073330] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.170Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1175gitlab # [ 110.077420] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.174Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1176gitlab # [ 110.081903] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.178Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1177gitlab # [ 110.086250] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.183Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1178gitlab # [ 110.090672] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.187Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1179gitlab # [ 110.095100] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.192Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1180gitlab # [ 110.099696] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.196Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1181gitlab # [ 110.103863] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.200Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1182gitlab # [ 110.108495] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.205Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1183gitlab # [ 110.112731] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.209Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1184gitlab # [ 110.117105] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.214Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1185gitlab # [ 110.121140] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.218Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1186gitlab # [ 110.125124] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.222Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1187gitlab # [ 110.129166] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.226Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1188gitlab # [ 110.133898] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.230Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1189gitlab # [ 110.137759] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.234Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1190gitlab # [ 110.141495] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.238Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1191gitlab # [ 110.143946] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.241Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1192gitlab # [ 110.146436] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.243Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1193gitlab # [ 110.148810] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.245Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1194gitlab # [ 110.151688] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.248Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1195gitlab # [ 110.154237] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.251Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1196gitlab # [ 110.158474] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.255Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1197gitlab # [ 110.162746] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.259Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1198gitlab # [ 110.165091] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.262Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1199gitlab # [ 110.167354] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.264Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1200gitlab # [ 110.169592] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.265Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1201gitlab # [ 110.172202] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.268Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1202gitlab # [ 110.173610] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.270Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1203gitlab # [ 110.185135] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.279Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1204gitlab # [ 110.185250] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.282Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1205gitlab # [ 110.186969] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.284Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1206gitlab # [ 110.189064] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.286Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1207gitlab # [ 110.190869] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.287Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1208gitlab # [ 110.193126] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.290Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1209gitlab # [ 110.194657] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.291Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1210gitlab # [ 110.196461] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.293Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1211gitlab # [ 110.198150] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.295Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1212gitlab # [ 110.199662] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.296Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1213gitlab # [ 110.201790] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.298Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1214gitlab # [ 110.204194] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.301Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1215gitlab # [ 110.206160] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.303Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1216gitlab # [ 110.208414] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.305Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1217gitlab # [ 110.209995] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.307Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1218gitlab # [ 110.211595] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.308Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1219gitlab # [ 110.213186] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.310Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1220gitlab # [ 110.215103] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.312Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1221gitlab # [ 110.235649] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.332Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1222gitlab # [ 110.239750] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.336Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1223gitlab # [ 110.243624] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.340Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1224gitlab # [ 110.247751] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.344Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1225gitlab # [ 110.251921] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.348Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1226gitlab # [ 110.256740] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.353Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1227gitlab # [ 110.260725] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.357Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1228gitlab # [ 110.265549] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.362Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1229gitlab # [ 110.269665] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.366Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1230gitlab # [ 110.275225] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.372Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1231gitlab # [ 110.279629] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.376Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1232gitlab # [ 110.282251] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.379Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1233gitlab # [ 110.284730] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.381Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1234gitlab # [ 110.287276] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.384Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1235gitlab # [ 110.289456] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.386Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1236gitlab # [ 110.292041] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.389Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1237gitlab # [ 110.293961] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.391Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1238gitlab # [ 110.296917] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.394Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1239gitlab # [ 110.298893] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.395Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1240gitlab # [ 110.301882] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.398Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1241gitlab # [ 110.303837] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.400Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1242gitlab # [ 110.306329] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.403Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1243gitlab # [ 110.309505] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.406Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1244gitlab # [ 110.311200] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.408Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1245gitlab # [ 110.314559] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.411Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1246gitlab # [ 110.317044] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.414Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1247gitlab # [ 110.319478] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.416Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1248gitlab # [ 110.321323] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.418Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1249gitlab # [ 110.332228] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.429Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1250gitlab # [ 110.333989] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.431Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1251gitlab # [ 110.336443] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.433Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1252gitlab # [ 110.339697] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.436Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1253gitlab # [ 110.342585] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.439Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1254gitlab # [ 110.344987] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.442Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1255gitlab # [ 110.347975] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.445Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1256gitlab # [ 110.350053] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.447Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1257gitlab # [ 110.352367] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.449Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1258gitlab # [ 110.355535] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.452Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1259gitlab # [ 110.357754] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:32:56.454Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1260gitlab # [ 118.475285] gitlab-workhorse[826]: time="2026-10-26T21:33:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1261gitlab # [ 128.477312] gitlab-workhorse[826]: time="2026-10-26T21:33:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 133.816468] postgres[2144]: [2144] ERROR: relation "table_without_models" does not exist1263gitlab # [ 133.817303] postgres[2144]: [2144] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1264gitlab # [ 136.418471] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:22.515Z","message":"Booted Rails 7.2.3.1 application in production environment"}1265gitlab # [ 136.422903] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:22.519Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1266gitlab # [ 136.425119] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:22.519Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1267gitlab # [ 136.427023] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:22.519Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1268gitlab # [ 136.429110] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:22.525Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1269gitlab # [ 137.930324] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:24.026Z","message":"Cleaning working queues"}1270gitlab # [ 137.933281] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:24.029Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"12f5fa2e873f324705dc024f","created_at":"2026-10-26T21:32:21.858Z","trace_propagation_headers":{"sentry-trace":"2d07219facc64dcfb6271a7c1958e53f-9845eeebf24f419e","baggage":"sentry-trace_id=2d07219facc64dcfb6271a7c1958e53f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"186ca65315db6aec6b6c90a830b4a27f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T21:32:21.868Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-12f5fa2e873f324705dc024f: start","job_status":"start","queue_duration_s":62.161009,"scheduling_latency_s":62.16108}1271gitlab # [ 138.089995] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:24.186Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"12f5fa2e873f324705dc024f","created_at":"2026-10-26T21:32:21.858Z","trace_propagation_headers":{"sentry-trace":"2d07219facc64dcfb6271a7c1958e53f-9845eeebf24f419e","baggage":"sentry-trace_id=2d07219facc64dcfb6271a7c1958e53f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"186ca65315db6aec6b6c90a830b4a27f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T21:32:21.868Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-12f5fa2e873f324705dc024f: done: 0.157162 sec","job_status":"done","queue_duration_s":62.161009,"scheduling_latency_s":62.16108,"redis_calls":31,"redis_duration_s":0.006405,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.003949,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001458,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08158243600000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.157162,"completed_at":"2026-10-26T21:33:24.186Z","load_balancing_strategy":"primary","db_duration_s":0.038569,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1272gitlab # [ 138.484913] gitlab-workhorse[826]: time="2026-10-26T21:33:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1273gitlab # [ 139.793562] postgres[2202]: [2202] ERROR: relation "table_without_models" does not exist1274gitlab # [ 139.794380] postgres[2202]: [2202] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1275gitlab # [ 142.852546] bundle[1612]: {"timestamp":"2026-10-26T21:33:28.949Z","pid":1612,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1276gitlab # [ 142.852787] bundle[1612]: {"timestamp":"2026-10-26T21:33:28.949Z","pid":1612,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1277gitlab # [ 142.854312] bundle[1612]: {"timestamp":"2026-10-26T21:33:28.949Z","pid":1612,"message":"! #\u003cThread:0x00007cd98d100cf0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1278gitlab # [ 142.854940] bundle[1612]: {"timestamp":"2026-10-26T21:33:28.949Z","pid":1612,"message":"! #\u003cThread:0x00007cd98d2d16b0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1279gitlab # [ 142.856064] bundle[1612]: {"timestamp":"2026-10-26T21:33:28.949Z","pid":1612,"message":"Use Ctrl-C to stop"}1280gitlab # [ 142.872748] bundle[1612]: {"timestamp":"2026-10-26T21:33:28.969Z","pid":1612,"message":"Sending status to systemd every 1.0 sec"}1281gitlab # [ 143.629746] bundle[1612]: {"timestamp":"2026-10-26T21:33:29.725Z","pid":1612,"message":"- Worker 0 (PID: 2263) booted in 0.72s, phase: 0"}1282gitlab # [ 143.688575] bundle[1612]: {"timestamp":"2026-10-26T21:33:29.785Z","pid":1612,"message":"- Worker 1 (PID: 2267) booted in 0.76s, phase: 0"}1283gitlab # [ 143.692270] systemd[1]: Started gitlab.service.1284gitlab # [ 143.692665] systemd[1]: Reached target Common target for all GitLab services..1285gitlab # [ 143.695062] systemd[1]: Starting setup-gitlab.service...1286gitlab # [ 143.714889] setup-gitlab-start[2300]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1287gitlab # [ 145.933775] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:33:32 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 21981288gitlab # [ 145.940987] setup-gitlab-start[2300]: + TOKEN=nixbot-test-token-of-20-chars1289gitlab # [ 145.941182] setup-gitlab-start[2300]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1290gitlab # [ 145.968960] runuser[2318]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1291gitlab # [ 146.372309] setup-gitlab-start[2319]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1292gitlab # [ 146.373220] setup-gitlab-start[2319]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1293gitlab # [ 146.374490] setup-gitlab-start[2319]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1294gitlab # [ 147.007562] setup-gitlab-start[2319]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1295gitlab # [ 147.007961] setup-gitlab-start[2319]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1296gitlab # [ 147.010364] setup-gitlab-start[2319]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1297gitlab # [ 149.593681] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:35.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"70bbcdc50164a90f02c535fa","created_at":"2026-10-26T21:33:35.668Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb69d1642f1e17d034dbde87ef641adb","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.687Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-70bbcdc50164a90f02c535fa: start","job_status":"start","queue_duration_s":0.002227,"scheduling_latency_s":0.002264}1298gitlab # [ 149.678542] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:35.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"70bbcdc50164a90f02c535fa","created_at":"2026-10-26T21:33:35.668Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb69d1642f1e17d034dbde87ef641adb","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.687Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-70bbcdc50164a90f02c535fa: done: 0.085575 sec","job_status":"done","queue_duration_s":0.002227,"scheduling_latency_s":0.002264,"redis_calls":10,"redis_duration_s":0.013419,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000858,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011649,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000515429,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.085575,"completed_at":"2026-10-26T21:33:35.775Z","load_balancing_strategy":"primary","db_duration_s":0.014524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 149.722490] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:35.819Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"70ed080b4c7bb91a29f48739","created_at":"2026-10-26T21:33:35.717Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59af6c594085fd279d51c0f96ffd12a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.724Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-70ed080b4c7bb91a29f48739: start","job_status":"start","queue_duration_s":0.094737,"scheduling_latency_s":0.094764}1300gitlab # [ 150.154860] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"70ed080b4c7bb91a29f48739","created_at":"2026-10-26T21:33:35.717Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59af6c594085fd279d51c0f96ffd12a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.724Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-70ed080b4c7bb91a29f48739: done: 0.432557 sec","job_status":"done","queue_duration_s":0.094737,"scheduling_latency_s":0.094764,"redis_calls":14,"redis_duration_s":0.013108,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.009984,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001631,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001493,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.085,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.082,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.17674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000735289,"exclusive_lock_hold_duration_s":0.376870803,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.432557,"completed_at":"2026-10-26T21:33:36.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.21263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 150.210480] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.307Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e177993655ef2fa0f0cff014","created_at":"2026-10-26T21:33:35.739Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33e2a480a0413818af33868fa00d7c78","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.768Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e177993655ef2fa0f0cff014: start","job_status":"start","queue_duration_s":0.538475,"scheduling_latency_s":0.538508}1302gitlab # [ 150.238399] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.335Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1303gitlab # [ 150.246501] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.343Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e177993655ef2fa0f0cff014","created_at":"2026-10-26T21:33:35.739Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33e2a480a0413818af33868fa00d7c78","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.768Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e177993655ef2fa0f0cff014: done: 0.036173 sec","job_status":"done","queue_duration_s":0.538475,"scheduling_latency_s":0.538508,"redis_calls":10,"redis_duration_s":0.003063,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000361499,"duration_s":0.036173,"completed_at":"2026-10-26T21:33:36.343Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 150.288193] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"ad79d22a78a8ccfb3d081993","created_at":"2026-10-26T21:33:35.815Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c20e47fc2509575dba72102beca1c79","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.838Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-ad79d22a78a8ccfb3d081993: start","job_status":"start","queue_duration_s":0.54685,"scheduling_latency_s":0.54688}1305gitlab # [ 150.328122] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.424Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"ad79d22a78a8ccfb3d081993","created_at":"2026-10-26T21:33:35.815Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c20e47fc2509575dba72102beca1c79","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.838Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-ad79d22a78a8ccfb3d081993: done: 0.039994 sec","job_status":"done","queue_duration_s":0.54685,"scheduling_latency_s":0.54688,"redis_calls":19,"redis_duration_s":0.009071,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.0007,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000269,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.007578,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000284673,"duration_s":0.039994,"completed_at":"2026-10-26T21:33:36.424Z","load_balancing_strategy":"primary","db_duration_s":0.002307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 150.372409] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c00916150bf6b1120ce83b07","created_at":"2026-10-26T21:33:35.856Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b18da0b007817badf29ad8d975d6529","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-26T21:33:35.865Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c00916150bf6b1120ce83b07: start","job_status":"start","queue_duration_s":0.603972,"scheduling_latency_s":0.604026}1307gitlab # [ 150.420278] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c00916150bf6b1120ce83b07","created_at":"2026-10-26T21:33:35.856Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b18da0b007817badf29ad8d975d6529","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-26T21:33:35.865Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c00916150bf6b1120ce83b07: done: 0.047631 sec","job_status":"done","queue_duration_s":0.603972,"scheduling_latency_s":0.604026,"redis_calls":10,"redis_duration_s":0.00258,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001528,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000526,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000393346,"duration_s":0.047631,"completed_at":"2026-10-26T21:33:36.516Z","load_balancing_strategy":"primary","db_duration_s":0.009569,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 150.461510] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0958fce622ae5cccb4035efa","created_at":"2026-10-26T21:33:35.879Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fe2f95cbdfb603e0678d138faefdc2a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.892Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0958fce622ae5cccb4035efa: start","job_status":"start","queue_duration_s":0.665658,"scheduling_latency_s":0.6657}1309gitlab # [ 150.491680] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.588Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1310gitlab # [ 150.505855] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.602Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0958fce622ae5cccb4035efa","created_at":"2026-10-26T21:33:35.879Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fe2f95cbdfb603e0678d138faefdc2a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.892Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0958fce622ae5cccb4035efa: done: 0.044695 sec","job_status":"done","queue_duration_s":0.665658,"scheduling_latency_s":0.6657,"redis_calls":10,"redis_duration_s":0.003685,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000409269,"duration_s":0.044695,"completed_at":"2026-10-26T21:33:36.602Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 150.547577] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bbf268e691e0b38b76564506","created_at":"2026-10-26T21:33:35.902Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"010d61c989a0964a77eebb517a4ad8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-26T21:33:35.909Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bbf268e691e0b38b76564506: start","job_status":"start","queue_duration_s":0.734327,"scheduling_latency_s":0.734465}1312gitlab # [ 150.577892] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.674Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1313gitlab # [ 150.597927] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bbf268e691e0b38b76564506","created_at":"2026-10-26T21:33:35.902Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"010d61c989a0964a77eebb517a4ad8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-26T21:33:35.909Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bbf268e691e0b38b76564506: done: 0.047482 sec","job_status":"done","queue_duration_s":0.734327,"scheduling_latency_s":0.734465,"redis_calls":10,"redis_duration_s":0.004524,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000564,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000500343,"duration_s":0.047482,"completed_at":"2026-10-26T21:33:36.691Z","load_balancing_strategy":"primary","db_duration_s":0.000648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 150.599056] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.695Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"00abf1d9cfa9b6ce402c53f5","created_at":"2026-10-26T21:33:35.928Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d27b1c2caf309257dbfeacd0f117d7cf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.935Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-00abf1d9cfa9b6ce402c53f5: start","job_status":"start","queue_duration_s":0.75966,"scheduling_latency_s":0.759681}1315gitlab # [ 150.708924] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.804Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"00abf1d9cfa9b6ce402c53f5","created_at":"2026-10-26T21:33:35.928Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d27b1c2caf309257dbfeacd0f117d7cf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.935Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-00abf1d9cfa9b6ce402c53f5: done: 0.10989 sec","job_status":"done","queue_duration_s":0.75966,"scheduling_latency_s":0.759681,"redis_calls":12,"redis_duration_s":0.00319,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000428,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001557,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001205,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008448,"exclusive_lock_hold_duration_s":0.012889348,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.10989,"completed_at":"2026-10-26T21:33:36.804Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 150.770683] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"89d746bd060a605f0a092a9c","created_at":"2026-10-26T21:33:35.944Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6da1376547a07047845fa0c60d81096","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.951Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-89d746bd060a605f0a092a9c: start","job_status":"start","queue_duration_s":0.915928,"scheduling_latency_s":0.91605}1317gitlab # [ 150.812504] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"89d746bd060a605f0a092a9c","created_at":"2026-10-26T21:33:35.944Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6da1376547a07047845fa0c60d81096","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.951Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-89d746bd060a605f0a092a9c: done: 0.041887 sec","job_status":"done","queue_duration_s":0.915928,"scheduling_latency_s":0.91605,"redis_calls":12,"redis_duration_s":0.004199,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002251,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000688,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032993,"duration_s":0.041887,"completed_at":"2026-10-26T21:33:36.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00104,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 150.853552] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:36.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5774c4dedede32bfedd768d7","created_at":"2026-10-26T21:33:35.971Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4865d9e175dd0eeb60f20686ff02263b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.978Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5774c4dedede32bfedd768d7: start","job_status":"start","queue_duration_s":0.972267,"scheduling_latency_s":0.972293}1319gitlab # [ 151.110286] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.206Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5774c4dedede32bfedd768d7","created_at":"2026-10-26T21:33:35.971Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4865d9e175dd0eeb60f20686ff02263b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.978Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5774c4dedede32bfedd768d7: done: 0.256687 sec","job_status":"done","queue_duration_s":0.972267,"scheduling_latency_s":0.972293,"redis_calls":565,"redis_duration_s":0.068951,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.067684,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.206934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000249752,"duration_s":0.256687,"completed_at":"2026-10-26T21:33:37.206Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 151.112186] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.209Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"f3952c456841c17878ca026c","created_at":"2026-10-26T21:33:35.984Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.992Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-f3952c456841c17878ca026c: start","job_status":"start","queue_duration_s":1.216221,"scheduling_latency_s":1.216237}1321gitlab # [ 151.199419] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.245Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"f3952c456841c17878ca026c","created_at":"2026-10-26T21:33:35.984Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:35.992Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-f3952c456841c17878ca026c: done: 0.036091 sec","job_status":"done","queue_duration_s":1.216221,"scheduling_latency_s":1.216237,"redis_calls":28,"redis_duration_s":0.004274,"redis_read_bytes":36,"redis_write_bytes":10583,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000594,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000315,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8295,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.002462,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000248914,"duration_s":0.036091,"completed_at":"2026-10-26T21:33:37.245Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003331,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 151.210722] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.246Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"11aa2bd51877af42b9738ace","created_at":"2026-10-26T21:33:36.000Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e8b53d29e12ee9af9b5941a56ccdfbf","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.009Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-11aa2bd51877af42b9738ace: start","job_status":"start","queue_duration_s":1.237059,"scheduling_latency_s":1.237073}1323gitlab # [ 151.224950] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"11aa2bd51877af42b9738ace","created_at":"2026-10-26T21:33:36.000Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e8b53d29e12ee9af9b5941a56ccdfbf","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.009Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-11aa2bd51877af42b9738ace: done: 0.01618 sec","job_status":"done","queue_duration_s":1.237059,"scheduling_latency_s":1.237073,"redis_calls":12,"redis_duration_s":0.001837,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000357308,"exclusive_lock_hold_duration_s":0.002146921,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.01618,"completed_at":"2026-10-26T21:33:37.262Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 151.287074] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.263Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c185de3a7ee31f488433d627","created_at":"2026-10-26T21:33:36.016Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3e2a42623c63bdf8ffbd8f83afb808b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.028Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c185de3a7ee31f488433d627: start","job_status":"start","queue_duration_s":1.235342,"scheduling_latency_s":1.235356}1325gitlab # [ 151.287843] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.285Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c185de3a7ee31f488433d627","created_at":"2026-10-26T21:33:36.016Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3e2a42623c63bdf8ffbd8f83afb808b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.028Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c185de3a7ee31f488433d627: done: 0.021675 sec","job_status":"done","queue_duration_s":1.235342,"scheduling_latency_s":1.235356,"redis_calls":16,"redis_duration_s":0.002341,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001217,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216229,"duration_s":0.021675,"completed_at":"2026-10-26T21:33:37.285Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002855,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 151.350960] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1841e305036e61dec2823170","created_at":"2026-10-26T21:33:36.041Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.050Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1841e305036e61dec2823170: start","job_status":"start","queue_duration_s":1.235625,"scheduling_latency_s":1.235639}1327gitlab # [ 151.351698] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.369Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1841e305036e61dec2823170","created_at":"2026-10-26T21:33:36.041Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.050Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1841e305036e61dec2823170: done: 0.083592 sec","job_status":"done","queue_duration_s":1.235625,"scheduling_latency_s":1.235639,"redis_calls":71,"redis_duration_s":0.022273,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.006726,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000607,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014547,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220978,"duration_s":0.083592,"completed_at":"2026-10-26T21:33:37.369Z","load_balancing_strategy":"primary","db_duration_s":0.002136,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 151.373307] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.371Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"488b72f9131d02c8ad5ef057","created_at":"2026-10-26T21:33:36.056Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f267e6f531f8c87ba40d38244a0a1b9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.063Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-488b72f9131d02c8ad5ef057: start","job_status":"start","queue_duration_s":1.308072,"scheduling_latency_s":1.308086}1329gitlab # [ 151.388244] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.379Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1330gitlab # [ 151.391627] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"488b72f9131d02c8ad5ef057","created_at":"2026-10-26T21:33:36.056Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f267e6f531f8c87ba40d38244a0a1b9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.063Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-488b72f9131d02c8ad5ef057: done: 0.013546 sec","job_status":"done","queue_duration_s":1.308072,"scheduling_latency_s":1.308086,"redis_calls":10,"redis_duration_s":0.00121,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197232,"duration_s":0.013546,"completed_at":"2026-10-26T21:33:37.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 151.446319] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.389Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fc9c080e5fbce008a829c289","created_at":"2026-10-26T21:33:36.075Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11f1ff8113d0ab73a8a0788b56d3c93","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-26T21:33:36.081Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fc9c080e5fbce008a829c289: start","job_status":"start","queue_duration_s":1.307882,"scheduling_latency_s":1.307897}1332gitlab # [ 151.448523] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.403Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1333gitlab # [ 151.449260] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.410Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fc9c080e5fbce008a829c289","created_at":"2026-10-26T21:33:36.075Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11f1ff8113d0ab73a8a0788b56d3c93","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-26T21:33:36.081Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fc9c080e5fbce008a829c289: done: 0.021332 sec","job_status":"done","queue_duration_s":1.307882,"scheduling_latency_s":1.307897,"redis_calls":10,"redis_duration_s":0.006222999999999999,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001117,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003649,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001457,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000982807,"duration_s":0.021332,"completed_at":"2026-10-26T21:33:37.410Z","load_balancing_strategy":"primary","db_duration_s":0.002565,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 151.486598] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.411Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d0a599d12e0cbd54f8087ad0","created_at":"2026-10-26T21:33:36.089Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54aa05a5d4cf2ac0d3bacbd19b684452","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.094Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d0a599d12e0cbd54f8087ad0: start","job_status":"start","queue_duration_s":1.317677,"scheduling_latency_s":1.317691}1335gitlab # [ 151.499134] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.430Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d0a599d12e0cbd54f8087ad0","created_at":"2026-10-26T21:33:36.089Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54aa05a5d4cf2ac0d3bacbd19b684452","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.094Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d0a599d12e0cbd54f8087ad0: done: 0.018461 sec","job_status":"done","queue_duration_s":1.317677,"scheduling_latency_s":1.317691,"redis_calls":12,"redis_duration_s":0.001833,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000678,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00034781,"exclusive_lock_hold_duration_s":0.004983873999999999,"duration_s":0.018461,"completed_at":"2026-10-26T21:33:37.430Z","load_balancing_strategy":"primary","db_duration_s":0.00215,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 151.538300] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.431Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"3d1ff68ba0db714ce1395e5e","created_at":"2026-10-26T21:33:36.107Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fa67bf32a217a4724929f950f0afa45","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.116Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-3d1ff68ba0db714ce1395e5e: start","job_status":"start","queue_duration_s":1.31515,"scheduling_latency_s":1.315164}1337gitlab # [ 151.581788] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.439Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1338gitlab # [ 151.582737] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"3d1ff68ba0db714ce1395e5e","created_at":"2026-10-26T21:33:36.107Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fa67bf32a217a4724929f950f0afa45","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.116Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-3d1ff68ba0db714ce1395e5e: done: 0.013417 sec","job_status":"done","queue_duration_s":1.31515,"scheduling_latency_s":1.315164,"redis_calls":10,"redis_duration_s":0.0016229999999999999,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218463,"duration_s":0.013417,"completed_at":"2026-10-26T21:33:37.444Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 151.628336] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"e28c8fc18e8bbcf2b17bd81f","created_at":"2026-10-26T21:33:36.123Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50633cd877810c0950b69374cd89c5d3","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.129Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-e28c8fc18e8bbcf2b17bd81f: start","job_status":"start","queue_duration_s":1.316534,"scheduling_latency_s":1.316547}1340gitlab # [ 151.629158] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.482Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"e28c8fc18e8bbcf2b17bd81f","created_at":"2026-10-26T21:33:36.123Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50633cd877810c0950b69374cd89c5d3","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.129Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-e28c8fc18e8bbcf2b17bd81f: done: 0.036796 sec","job_status":"done","queue_duration_s":1.316534,"scheduling_latency_s":1.316547,"redis_calls":12,"redis_duration_s":0.01018,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001824,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004488,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003868,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000506209,"exclusive_lock_hold_duration_s":0.010924294,"duration_s":0.036796,"completed_at":"2026-10-26T21:33:37.482Z","load_balancing_strategy":"primary","db_duration_s":0.007785,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 151.652056] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5d1a094f039ec209293eba1f","created_at":"2026-10-26T21:33:36.139Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"893ae7411e86b3172b4acbbc28c556d1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.148Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5d1a094f039ec209293eba1f: start","job_status":"start","queue_duration_s":1.336565,"scheduling_latency_s":1.336581}1342gitlab # [ 151.701292] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5d1a094f039ec209293eba1f","created_at":"2026-10-26T21:33:36.139Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"893ae7411e86b3172b4acbbc28c556d1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.148Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5d1a094f039ec209293eba1f: done: 0.024337 sec","job_status":"done","queue_duration_s":1.336565,"scheduling_latency_s":1.336581,"redis_calls":10,"redis_duration_s":0.0043289999999999995,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001119,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002101,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214553,"duration_s":0.024337,"completed_at":"2026-10-26T21:33:37.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003493,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 151.705620] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8422cd4b71831fc321100928","created_at":"2026-10-26T21:33:36.167Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4297d7cce3b9bd49d5bed0e5746d0fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.179Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8422cd4b71831fc321100928: start","job_status":"start","queue_duration_s":1.331829,"scheduling_latency_s":1.331844}1344gitlab # [ 151.719549] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8422cd4b71831fc321100928","created_at":"2026-10-26T21:33:36.167Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4297d7cce3b9bd49d5bed0e5746d0fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.179Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8422cd4b71831fc321100928: done: 0.021488 sec","job_status":"done","queue_duration_s":1.331829,"scheduling_latency_s":1.331844,"redis_calls":13,"redis_duration_s":0.0017720000000000001,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000635,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006378744,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.021488,"completed_at":"2026-10-26T21:33:37.532Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001653,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1345gitlab # [ 151.799104] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"6d545b5e549e44ee0d6c0bc9","created_at":"2026-10-26T21:33:36.195Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a229a1a751154be1b6b9e4d98f63956","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.204Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-6d545b5e549e44ee0d6c0bc9: start","job_status":"start","queue_duration_s":1.329404,"scheduling_latency_s":1.329417}1346gitlab # [ 151.799830] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.565Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"6d545b5e549e44ee0d6c0bc9","created_at":"2026-10-26T21:33:36.195Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a229a1a751154be1b6b9e4d98f63956","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.204Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-6d545b5e549e44ee0d6c0bc9: done: 0.032239 sec","job_status":"done","queue_duration_s":1.329404,"scheduling_latency_s":1.329417,"redis_calls":12,"redis_duration_s":0.004875,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001357,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00034306,"exclusive_lock_hold_duration_s":0.015879393,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.032239,"completed_at":"2026-10-26T21:33:37.565Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008943,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 151.858753] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ae125d3165b896b20f99b635","created_at":"2026-10-26T21:33:36.213Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddedb9aeafc3048e6b43043153739aa8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.220Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ae125d3165b896b20f99b635: start","job_status":"start","queue_duration_s":1.348931,"scheduling_latency_s":1.348946}1348gitlab # [ 151.859662] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.588Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ae125d3165b896b20f99b635","created_at":"2026-10-26T21:33:36.213Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddedb9aeafc3048e6b43043153739aa8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.220Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ae125d3165b896b20f99b635: done: 0.019198 sec","job_status":"done","queue_duration_s":1.348931,"scheduling_latency_s":1.348946,"redis_calls":10,"redis_duration_s":0.005769,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001368,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000464025,"duration_s":0.019198,"completed_at":"2026-10-26T21:33:37.588Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 151.908802] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.591Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"103416b0cc3aab4378282d63","created_at":"2026-10-26T21:33:36.406Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-cf1e772774d54d2a","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9c20e47fc2509575dba72102beca1c79","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.418Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-103416b0cc3aab4378282d63: start","job_status":"start","queue_duration_s":1.173512,"scheduling_latency_s":1.173526}1350gitlab # [ 151.909741] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.608Z","message":"No existing merge request to be cleaned up."}1351gitlab # [ 151.910495] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.617Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"103416b0cc3aab4378282d63","created_at":"2026-10-26T21:33:36.406Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-cf1e772774d54d2a","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9c20e47fc2509575dba72102beca1c79","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.418Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-103416b0cc3aab4378282d63: done: 0.026223 sec","job_status":"done","queue_duration_s":1.173512,"scheduling_latency_s":1.173526,"redis_calls":13,"redis_duration_s":0.004487,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001353,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001602,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222375,"duration_s":0.026223,"completed_at":"2026-10-26T21:33:37.617Z","load_balancing_strategy":"primary","db_duration_s":0.00485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 151.953471] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.618Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"56fd4373e541a54fa18ca0fd","created_at":"2026-10-26T21:33:36.406Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-cf1e772774d54d2a","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9c20e47fc2509575dba72102beca1c79","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.418Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-56fd4373e541a54fa18ca0fd: start","job_status":"start","queue_duration_s":1.200748,"scheduling_latency_s":1.200762}1353gitlab # [ 151.954286] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.627Z","message":"No existing merge request to be cleaned up."}1354gitlab # [ 151.954839] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.632Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"56fd4373e541a54fa18ca0fd","created_at":"2026-10-26T21:33:36.406Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-cf1e772774d54d2a","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9c20e47fc2509575dba72102beca1c79","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.418Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-56fd4373e541a54fa18ca0fd: done: 0.013746 sec","job_status":"done","queue_duration_s":1.200748,"scheduling_latency_s":1.200762,"redis_calls":10,"redis_duration_s":0.001469,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000843,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013746,"completed_at":"2026-10-26T21:33:37.632Z","load_balancing_strategy":"primary","db_duration_s":0.00271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 151.979189] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.633Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8e85fe504afe21dceb7546a0","created_at":"2026-10-26T21:33:36.406Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-cf1e772774d54d2a","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9c20e47fc2509575dba72102beca1c79","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.418Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8e85fe504afe21dceb7546a0: start","job_status":"start","queue_duration_s":1.215444,"scheduling_latency_s":1.215458}1356gitlab # [ 151.991735] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.640Z","message":"No existing merge request to be cleaned up."}1357gitlab # [ 151.993208] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.646Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8e85fe504afe21dceb7546a0","created_at":"2026-10-26T21:33:36.406Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-cf1e772774d54d2a","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9c20e47fc2509575dba72102beca1c79","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.418Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8e85fe504afe21dceb7546a0: done: 0.012593 sec","job_status":"done","queue_duration_s":1.215444,"scheduling_latency_s":1.215458,"redis_calls":10,"redis_duration_s":0.0013800000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000831,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012593,"completed_at":"2026-10-26T21:33:37.646Z","load_balancing_strategy":"primary","db_duration_s":0.000979,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 152.056680] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.647Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8f0611e362a06d5d21d00af1","created_at":"2026-10-26T21:33:36.406Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-cf1e772774d54d2a","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9c20e47fc2509575dba72102beca1c79","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.418Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8f0611e362a06d5d21d00af1: start","job_status":"start","queue_duration_s":1.229192,"scheduling_latency_s":1.229206}1359gitlab # [ 152.057613] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.654Z","message":"No existing merge request to be cleaned up."}1360gitlab # [ 152.058212] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.659Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8f0611e362a06d5d21d00af1","created_at":"2026-10-26T21:33:36.406Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-cf1e772774d54d2a","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9c20e47fc2509575dba72102beca1c79","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:36.418Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8f0611e362a06d5d21d00af1: done: 0.01225 sec","job_status":"done","queue_duration_s":1.229192,"scheduling_latency_s":1.229206,"redis_calls":10,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000831,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01225,"completed_at":"2026-10-26T21:33:37.659Z","load_balancing_strategy":"primary","db_duration_s":0.001127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 152.084414] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"98d15e1be4ed03d08a17e19d","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-98d15e1be4ed03d08a17e19d: start","job_status":"start","queue_duration_s":0.421501,"scheduling_latency_s":0.421515}1362gitlab # [ 152.098257] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"98d15e1be4ed03d08a17e19d","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-98d15e1be4ed03d08a17e19d: done: 0.028516 sec","job_status":"done","queue_duration_s":0.421501,"scheduling_latency_s":0.421515,"redis_calls":16,"redis_duration_s":0.002413,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001351,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000241372,"duration_s":0.028516,"completed_at":"2026-10-26T21:33:37.689Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 152.149599] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c35e752e0e38b6a6c8754275","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c35e752e0e38b6a6c8754275: start","job_status":"start","queue_duration_s":0.451286,"scheduling_latency_s":0.4513}1364gitlab # [ 152.151492] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c35e752e0e38b6a6c8754275","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c35e752e0e38b6a6c8754275: done: 0.012448 sec","job_status":"done","queue_duration_s":0.451286,"scheduling_latency_s":0.4513,"redis_calls":13,"redis_duration_s":0.001959,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012448,"completed_at":"2026-10-26T21:33:37.702Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 152.188157] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"76fd3d3f1de7e86badcf90aa","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-76fd3d3f1de7e86badcf90aa: start","job_status":"start","queue_duration_s":0.464794,"scheduling_latency_s":0.464808}1366gitlab # [ 152.200564] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"76fd3d3f1de7e86badcf90aa","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-76fd3d3f1de7e86badcf90aa: done: 0.011299 sec","job_status":"done","queue_duration_s":0.464794,"scheduling_latency_s":0.464808,"redis_calls":13,"redis_duration_s":0.001804,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011299,"completed_at":"2026-10-26T21:33:37.715Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 152.254846] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"cc3f4baca0923dbe91ae20a4","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-cc3f4baca0923dbe91ae20a4: start","job_status":"start","queue_duration_s":0.476991,"scheduling_latency_s":0.477005}1368gitlab # [ 152.255736] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"cc3f4baca0923dbe91ae20a4","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-cc3f4baca0923dbe91ae20a4: done: 0.011477 sec","job_status":"done","queue_duration_s":0.476991,"scheduling_latency_s":0.477005,"redis_calls":13,"redis_duration_s":0.001764,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011477,"completed_at":"2026-10-26T21:33:37.727Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 152.318681] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4a49c6247f1ce3e12a3a4029","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4a49c6247f1ce3e12a3a4029: start","job_status":"start","queue_duration_s":0.489456,"scheduling_latency_s":0.48947}1370gitlab # [ 152.319477] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4a49c6247f1ce3e12a3a4029","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4a49c6247f1ce3e12a3a4029: done: 0.011317 sec","job_status":"done","queue_duration_s":0.489456,"scheduling_latency_s":0.48947,"redis_calls":13,"redis_duration_s":0.001804,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011317,"completed_at":"2026-10-26T21:33:37.739Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 152.373549] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f90f6cb21cb2cb45764ac8cb","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f90f6cb21cb2cb45764ac8cb: start","job_status":"start","queue_duration_s":0.501962,"scheduling_latency_s":0.501977}1372gitlab # [ 152.374490] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f90f6cb21cb2cb45764ac8cb","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f90f6cb21cb2cb45764ac8cb: done: 0.011468 sec","job_status":"done","queue_duration_s":0.501962,"scheduling_latency_s":0.501977,"redis_calls":13,"redis_duration_s":0.0018939999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011468,"completed_at":"2026-10-26T21:33:37.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 152.428941] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"6adbd9d3a838e7516086ee76","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-6adbd9d3a838e7516086ee76: start","job_status":"start","queue_duration_s":0.514404,"scheduling_latency_s":0.514418}1374gitlab # [ 152.429922] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"6adbd9d3a838e7516086ee76","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-6adbd9d3a838e7516086ee76: done: 0.011282 sec","job_status":"done","queue_duration_s":0.514404,"scheduling_latency_s":0.514418,"redis_calls":13,"redis_duration_s":0.001684,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011282,"completed_at":"2026-10-26T21:33:37.764Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 152.440164] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7aaed5affc2fe6b0d654b68a","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7aaed5affc2fe6b0d654b68a: start","job_status":"start","queue_duration_s":0.526615,"scheduling_latency_s":0.526629}1376gitlab # [ 152.454258] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7aaed5affc2fe6b0d654b68a","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7aaed5affc2fe6b0d654b68a: done: 0.011446 sec","job_status":"done","queue_duration_s":0.526615,"scheduling_latency_s":0.526629,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011446,"completed_at":"2026-10-26T21:33:37.777Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00057,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 152.502154] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fd61b1b3ad132a95655ce4b5","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fd61b1b3ad132a95655ce4b5: start","job_status":"start","queue_duration_s":0.539325,"scheduling_latency_s":0.539339}1378gitlab # [ 152.547595] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fd61b1b3ad132a95655ce4b5","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fd61b1b3ad132a95655ce4b5: done: 0.011204 sec","job_status":"done","queue_duration_s":0.539325,"scheduling_latency_s":0.539339,"redis_calls":13,"redis_duration_s":0.0016290000000000002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011204,"completed_at":"2026-10-26T21:33:37.789Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 152.548681] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4e8b2cd9febf6a1d12877464","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4e8b2cd9febf6a1d12877464: start","job_status":"start","queue_duration_s":0.551481,"scheduling_latency_s":0.551495}1380gitlab # [ 152.591664] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4e8b2cd9febf6a1d12877464","created_at":"2026-10-26T21:33:37.225Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-bb60938b5aeb4045","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"f98eb2b5be6030e670c2d8020e72891d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.239Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4e8b2cd9febf6a1d12877464: done: 0.011664 sec","job_status":"done","queue_duration_s":0.551481,"scheduling_latency_s":0.551495,"redis_calls":13,"redis_duration_s":0.001636,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011664,"completed_at":"2026-10-26T21:33:37.802Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 152.636429] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f1c3de88bba7fd7d8756233","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f1c3de88bba7fd7d8756233: start","job_status":"start","queue_duration_s":0.440316,"scheduling_latency_s":0.44033}1382gitlab # [ 152.637206] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f1c3de88bba7fd7d8756233","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f1c3de88bba7fd7d8756233: done: 0.015975 sec","job_status":"done","queue_duration_s":0.440316,"scheduling_latency_s":0.44033,"redis_calls":16,"redis_duration_s":0.002195,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000235505,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015975,"completed_at":"2026-10-26T21:33:37.819Z","load_balancing_strategy":"primary","db_duration_s":0.000315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 152.686785] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb4ebf8dd4b718ee75da9270","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb4ebf8dd4b718ee75da9270: start","job_status":"start","queue_duration_s":0.457233,"scheduling_latency_s":0.457246}1384gitlab # [ 152.687649] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb4ebf8dd4b718ee75da9270","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb4ebf8dd4b718ee75da9270: done: 0.010857 sec","job_status":"done","queue_duration_s":0.457233,"scheduling_latency_s":0.457246,"redis_calls":13,"redis_duration_s":0.001666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010857,"completed_at":"2026-10-26T21:33:37.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 152.699644] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"058ae1861dae0a467c3fdc4d","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-058ae1861dae0a467c3fdc4d: start","job_status":"start","queue_duration_s":0.468981,"scheduling_latency_s":0.468995}1386gitlab # [ 152.712115] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"058ae1861dae0a467c3fdc4d","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-058ae1861dae0a467c3fdc4d: done: 0.010543 sec","job_status":"done","queue_duration_s":0.468981,"scheduling_latency_s":0.468995,"redis_calls":13,"redis_duration_s":0.0018290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010543,"completed_at":"2026-10-26T21:33:37.842Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 152.771812] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dd4ff7c11b86e9134426020","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dd4ff7c11b86e9134426020: start","job_status":"start","queue_duration_s":0.480413,"scheduling_latency_s":0.480427}1388gitlab # [ 152.772715] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dd4ff7c11b86e9134426020","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dd4ff7c11b86e9134426020: done: 0.010614 sec","job_status":"done","queue_duration_s":0.480413,"scheduling_latency_s":0.480427,"redis_calls":13,"redis_duration_s":0.001705,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010614,"completed_at":"2026-10-26T21:33:37.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 152.802322] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e18b864974e0ce182354c93f","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e18b864974e0ce182354c93f: start","job_status":"start","queue_duration_s":0.491894,"scheduling_latency_s":0.491907}1390gitlab # [ 152.814851] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e18b864974e0ce182354c93f","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e18b864974e0ce182354c93f: done: 0.010723 sec","job_status":"done","queue_duration_s":0.491894,"scheduling_latency_s":0.491907,"redis_calls":13,"redis_duration_s":0.001696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010723,"completed_at":"2026-10-26T21:33:37.865Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 152.864727] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06ff3c3b619a37f4a8ff108d","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06ff3c3b619a37f4a8ff108d: start","job_status":"start","queue_duration_s":0.503553,"scheduling_latency_s":0.503567}1392gitlab # [ 152.909378] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06ff3c3b619a37f4a8ff108d","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06ff3c3b619a37f4a8ff108d: done: 0.010145 sec","job_status":"done","queue_duration_s":0.503553,"scheduling_latency_s":0.503567,"redis_calls":13,"redis_duration_s":0.001644,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010145,"completed_at":"2026-10-26T21:33:37.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 152.910879] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"714af490d41d365e7bd2102a","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-714af490d41d365e7bd2102a: start","job_status":"start","queue_duration_s":0.514728,"scheduling_latency_s":0.514741}1394gitlab # [ 152.962246] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"714af490d41d365e7bd2102a","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-714af490d41d365e7bd2102a: done: 0.010418 sec","job_status":"done","queue_duration_s":0.514728,"scheduling_latency_s":0.514741,"redis_calls":13,"redis_duration_s":0.0016259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010418,"completed_at":"2026-10-26T21:33:37.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 152.963352] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6486a477a20a3c4bb78b6996","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6486a477a20a3c4bb78b6996: start","job_status":"start","queue_duration_s":0.526559,"scheduling_latency_s":0.526572}1396gitlab # [ 152.974045] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6486a477a20a3c4bb78b6996","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6486a477a20a3c4bb78b6996: done: 0.01155 sec","job_status":"done","queue_duration_s":0.526559,"scheduling_latency_s":0.526572,"redis_calls":13,"redis_duration_s":0.002006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001234,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01155,"completed_at":"2026-10-26T21:33:37.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 153.039246] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"448ba895ee94f5ab19094387","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-448ba895ee94f5ab19094387: start","job_status":"start","queue_duration_s":0.539427,"scheduling_latency_s":0.539444}1398gitlab # [ 153.040076] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"448ba895ee94f5ab19094387","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-448ba895ee94f5ab19094387: done: 0.012051 sec","job_status":"done","queue_duration_s":0.539427,"scheduling_latency_s":0.539444,"redis_calls":13,"redis_duration_s":0.002039,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012051,"completed_at":"2026-10-26T21:33:37.914Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 153.072803] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2eb7596326d32a936bc7e34","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2eb7596326d32a936bc7e34: start","job_status":"start","queue_duration_s":0.552714,"scheduling_latency_s":0.552729}1400gitlab # [ 153.122766] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2eb7596326d32a936bc7e34","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2eb7596326d32a936bc7e34: done: 0.012797 sec","job_status":"done","queue_duration_s":0.552714,"scheduling_latency_s":0.552729,"redis_calls":13,"redis_duration_s":0.0020930000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001436,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012797,"completed_at":"2026-10-26T21:33:37.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 153.124842] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f2c150fbc0cce16e26b1d0e","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f2c150fbc0cce16e26b1d0e: start","job_status":"start","queue_duration_s":0.56697,"scheduling_latency_s":0.566989}1402gitlab # [ 153.139710] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f2c150fbc0cce16e26b1d0e","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f2c150fbc0cce16e26b1d0e: done: 0.011899 sec","job_status":"done","queue_duration_s":0.56697,"scheduling_latency_s":0.566989,"redis_calls":13,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011899,"completed_at":"2026-10-26T21:33:37.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 153.185888] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34da2da33e1b547818cbb18e","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34da2da33e1b547818cbb18e: start","job_status":"start","queue_duration_s":0.579807,"scheduling_latency_s":0.579823}1404gitlab # [ 153.200912] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34da2da33e1b547818cbb18e","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34da2da33e1b547818cbb18e: done: 0.011684 sec","job_status":"done","queue_duration_s":0.579807,"scheduling_latency_s":0.579823,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011684,"completed_at":"2026-10-26T21:33:37.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 153.248522] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2475a02bef861afec7312c30","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2475a02bef861afec7312c30: start","job_status":"start","queue_duration_s":0.59242,"scheduling_latency_s":0.592434}1406gitlab # [ 153.253664] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2475a02bef861afec7312c30","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2475a02bef861afec7312c30: done: 0.014255 sec","job_status":"done","queue_duration_s":0.59242,"scheduling_latency_s":0.592434,"redis_calls":13,"redis_duration_s":0.0019820000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001422,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014255,"completed_at":"2026-10-26T21:33:37.969Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 153.341709] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"419a98511c0e290d32c82fc0","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-419a98511c0e290d32c82fc0: start","job_status":"start","queue_duration_s":0.607672,"scheduling_latency_s":0.607686}1408gitlab # [ 153.342715] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"419a98511c0e290d32c82fc0","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-419a98511c0e290d32c82fc0: done: 0.011032 sec","job_status":"done","queue_duration_s":0.607672,"scheduling_latency_s":0.607686,"redis_calls":13,"redis_duration_s":0.001755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001217,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011032,"completed_at":"2026-10-26T21:33:37.981Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 153.350875] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7fdeeaa0bd7bf84d55eb88c","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7fdeeaa0bd7bf84d55eb88c: start","job_status":"start","queue_duration_s":0.61963,"scheduling_latency_s":0.619644}1410gitlab # [ 153.363281] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7fdeeaa0bd7bf84d55eb88c","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7fdeeaa0bd7bf84d55eb88c: done: 0.010929 sec","job_status":"done","queue_duration_s":0.61963,"scheduling_latency_s":0.619644,"redis_calls":13,"redis_duration_s":0.001815,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001284,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010929,"completed_at":"2026-10-26T21:33:37.993Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 153.401938] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:37.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b90671a4f5d5c4583c66a3e0","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b90671a4f5d5c4583c66a3e0: start","job_status":"start","queue_duration_s":0.631654,"scheduling_latency_s":0.631669}1412gitlab # [ 153.450254] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b90671a4f5d5c4583c66a3e0","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b90671a4f5d5c4583c66a3e0: done: 0.010804 sec","job_status":"done","queue_duration_s":0.631654,"scheduling_latency_s":0.631669,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010804,"completed_at":"2026-10-26T21:33:38.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 153.452028] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b7ad1e6f2df994efda059e7","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b7ad1e6f2df994efda059e7: start","job_status":"start","queue_duration_s":0.643329,"scheduling_latency_s":0.643353}1414gitlab # [ 153.496304] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b7ad1e6f2df994efda059e7","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b7ad1e6f2df994efda059e7: done: 0.010733 sec","job_status":"done","queue_duration_s":0.643329,"scheduling_latency_s":0.643353,"redis_calls":13,"redis_duration_s":0.001681,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010733,"completed_at":"2026-10-26T21:33:38.016Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 153.504599] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0642b96298a5598c4da296a1","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0642b96298a5598c4da296a1: start","job_status":"start","queue_duration_s":0.655126,"scheduling_latency_s":0.65514}1416gitlab # [ 153.518162] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0642b96298a5598c4da296a1","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0642b96298a5598c4da296a1: done: 0.0106 sec","job_status":"done","queue_duration_s":0.655126,"scheduling_latency_s":0.65514,"redis_calls":13,"redis_duration_s":0.001652,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0106,"completed_at":"2026-10-26T21:33:38.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 153.580612] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abfd34f434e4d2783a3de452","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abfd34f434e4d2783a3de452: start","job_status":"start","queue_duration_s":0.666909,"scheduling_latency_s":0.666923}1418gitlab # [ 153.581628] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abfd34f434e4d2783a3de452","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abfd34f434e4d2783a3de452: done: 0.010548 sec","job_status":"done","queue_duration_s":0.666909,"scheduling_latency_s":0.666923,"redis_calls":13,"redis_duration_s":0.001694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010548,"completed_at":"2026-10-26T21:33:38.040Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 153.640894] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fd439cf2bf0ea8df754e9b5","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fd439cf2bf0ea8df754e9b5: start","job_status":"start","queue_duration_s":0.678504,"scheduling_latency_s":0.678517}1420gitlab # [ 153.641754] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fd439cf2bf0ea8df754e9b5","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fd439cf2bf0ea8df754e9b5: done: 0.010642 sec","job_status":"done","queue_duration_s":0.678504,"scheduling_latency_s":0.678517,"redis_calls":13,"redis_duration_s":0.0017529999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010642,"completed_at":"2026-10-26T21:33:38.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 153.693477] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"322865d29cbb496a1e03e301","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-322865d29cbb496a1e03e301: start","job_status":"start","queue_duration_s":0.690207,"scheduling_latency_s":0.690221}1422gitlab # [ 153.694606] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"322865d29cbb496a1e03e301","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-322865d29cbb496a1e03e301: done: 0.010647 sec","job_status":"done","queue_duration_s":0.690207,"scheduling_latency_s":0.690221,"redis_calls":13,"redis_duration_s":0.0017,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010647,"completed_at":"2026-10-26T21:33:38.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 153.754781] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee43d8073e08841420e74e46","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee43d8073e08841420e74e46: start","job_status":"start","queue_duration_s":0.702039,"scheduling_latency_s":0.702053}1424gitlab # [ 153.756058] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee43d8073e08841420e74e46","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee43d8073e08841420e74e46: done: 0.010801 sec","job_status":"done","queue_duration_s":0.702039,"scheduling_latency_s":0.702053,"redis_calls":13,"redis_duration_s":0.0016870000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010801,"completed_at":"2026-10-26T21:33:38.075Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 153.769132] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cbaf8c05fca1ac1c9046f67","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cbaf8c05fca1ac1c9046f67: start","job_status":"start","queue_duration_s":0.713797,"scheduling_latency_s":0.713815}1426gitlab # [ 153.817819] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cbaf8c05fca1ac1c9046f67","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cbaf8c05fca1ac1c9046f67: done: 0.010874 sec","job_status":"done","queue_duration_s":0.713797,"scheduling_latency_s":0.713815,"redis_calls":13,"redis_duration_s":0.0016560000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010874,"completed_at":"2026-10-26T21:33:38.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 153.822058] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4a00f61dd656972e2a22efb","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4a00f61dd656972e2a22efb: start","job_status":"start","queue_duration_s":0.725611,"scheduling_latency_s":0.725625}1428gitlab # [ 153.835432] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4a00f61dd656972e2a22efb","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4a00f61dd656972e2a22efb: done: 0.010982 sec","job_status":"done","queue_duration_s":0.725611,"scheduling_latency_s":0.725625,"redis_calls":13,"redis_duration_s":0.001888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010982,"completed_at":"2026-10-26T21:33:38.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 153.901362] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"166d3bab8511da8cb990a6e2","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-166d3bab8511da8cb990a6e2: start","job_status":"start","queue_duration_s":0.737513,"scheduling_latency_s":0.737528}1430gitlab # [ 153.902144] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"166d3bab8511da8cb990a6e2","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-166d3bab8511da8cb990a6e2: done: 0.010979 sec","job_status":"done","queue_duration_s":0.737513,"scheduling_latency_s":0.737528,"redis_calls":13,"redis_duration_s":0.001704,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010979,"completed_at":"2026-10-26T21:33:38.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 153.949532] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5f19902d9bbe43dff298ccf","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5f19902d9bbe43dff298ccf: start","job_status":"start","queue_duration_s":0.749443,"scheduling_latency_s":0.749457}1432gitlab # [ 153.950503] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5f19902d9bbe43dff298ccf","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5f19902d9bbe43dff298ccf: done: 0.010812 sec","job_status":"done","queue_duration_s":0.749443,"scheduling_latency_s":0.749457,"redis_calls":13,"redis_duration_s":0.0017430000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001206,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010812,"completed_at":"2026-10-26T21:33:38.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 154.002349] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d56a04ee754bc30538014eb","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d56a04ee754bc30538014eb: start","job_status":"start","queue_duration_s":0.761153,"scheduling_latency_s":0.761166}1434gitlab # [ 154.003128] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d56a04ee754bc30538014eb","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d56a04ee754bc30538014eb: done: 0.010652 sec","job_status":"done","queue_duration_s":0.761153,"scheduling_latency_s":0.761166,"redis_calls":13,"redis_duration_s":0.001825,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010652,"completed_at":"2026-10-26T21:33:38.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 154.050350] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23057576d0c2e4099801907c","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23057576d0c2e4099801907c: start","job_status":"start","queue_duration_s":0.772736,"scheduling_latency_s":0.77275}1436gitlab # [ 154.051438] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23057576d0c2e4099801907c","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23057576d0c2e4099801907c: done: 0.010682 sec","job_status":"done","queue_duration_s":0.772736,"scheduling_latency_s":0.77275,"redis_calls":13,"redis_duration_s":0.0017140000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010682,"completed_at":"2026-10-26T21:33:38.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 154.105072] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63de5dea87d36b6c7d3ce648","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63de5dea87d36b6c7d3ce648: start","job_status":"start","queue_duration_s":0.784497,"scheduling_latency_s":0.784511}1438gitlab # [ 154.106105] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63de5dea87d36b6c7d3ce648","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63de5dea87d36b6c7d3ce648: done: 0.010809 sec","job_status":"done","queue_duration_s":0.784497,"scheduling_latency_s":0.784511,"redis_calls":13,"redis_duration_s":0.0016910000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001154,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010809,"completed_at":"2026-10-26T21:33:38.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 154.139099] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a882a7df5fee27ddfe8bebb9","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a882a7df5fee27ddfe8bebb9: start","job_status":"start","queue_duration_s":0.796422,"scheduling_latency_s":0.796437}1440gitlab # [ 154.154125] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a882a7df5fee27ddfe8bebb9","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a882a7df5fee27ddfe8bebb9: done: 0.010633 sec","job_status":"done","queue_duration_s":0.796422,"scheduling_latency_s":0.796437,"redis_calls":13,"redis_duration_s":0.0017759999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010633,"completed_at":"2026-10-26T21:33:38.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 154.201092] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"903762a3496ceb589e7be54c","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-903762a3496ceb589e7be54c: start","job_status":"start","queue_duration_s":0.808104,"scheduling_latency_s":0.808118}1442gitlab # [ 154.205540] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"903762a3496ceb589e7be54c","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-903762a3496ceb589e7be54c: done: 0.01055 sec","job_status":"done","queue_duration_s":0.808104,"scheduling_latency_s":0.808118,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01055,"completed_at":"2026-10-26T21:33:38.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 154.248809] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e574afccdeeb46335b69ae2e","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e574afccdeeb46335b69ae2e: start","job_status":"start","queue_duration_s":0.819907,"scheduling_latency_s":0.819922}1444gitlab # [ 154.292855] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e574afccdeeb46335b69ae2e","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e574afccdeeb46335b69ae2e: done: 0.010846 sec","job_status":"done","queue_duration_s":0.819907,"scheduling_latency_s":0.819922,"redis_calls":13,"redis_duration_s":0.0016940000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010846,"completed_at":"2026-10-26T21:33:38.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 154.294779] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db2a5af1783e8a69543a0c24","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db2a5af1783e8a69543a0c24: start","job_status":"start","queue_duration_s":0.83214,"scheduling_latency_s":0.832156}1446gitlab # [ 154.307909] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db2a5af1783e8a69543a0c24","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db2a5af1783e8a69543a0c24: done: 0.014374 sec","job_status":"done","queue_duration_s":0.83214,"scheduling_latency_s":0.832156,"redis_calls":13,"redis_duration_s":0.002489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001527,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014374,"completed_at":"2026-10-26T21:33:38.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 154.383827] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1961760d39c597459332a03","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1961760d39c597459332a03: start","job_status":"start","queue_duration_s":0.847752,"scheduling_latency_s":0.847772}1448gitlab # [ 154.384808] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1961760d39c597459332a03","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1961760d39c597459332a03: done: 0.014384 sec","job_status":"done","queue_duration_s":0.847752,"scheduling_latency_s":0.847772,"redis_calls":13,"redis_duration_s":0.001888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001288,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014384,"completed_at":"2026-10-26T21:33:38.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 154.436137] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01a076064998e21b499adfec","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01a076064998e21b499adfec: start","job_status":"start","queue_duration_s":0.863395,"scheduling_latency_s":0.863414}1450gitlab # [ 154.437191] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01a076064998e21b499adfec","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01a076064998e21b499adfec: done: 0.014614 sec","job_status":"done","queue_duration_s":0.863395,"scheduling_latency_s":0.863414,"redis_calls":13,"redis_duration_s":0.001942,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014614,"completed_at":"2026-10-26T21:33:38.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 154.450762] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"322fcd1f8e6375e68a51bc90","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-322fcd1f8e6375e68a51bc90: start","job_status":"start","queue_duration_s":0.878975,"scheduling_latency_s":0.878991}1452gitlab # [ 154.500204] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"322fcd1f8e6375e68a51bc90","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-322fcd1f8e6375e68a51bc90: done: 0.011726 sec","job_status":"done","queue_duration_s":0.878975,"scheduling_latency_s":0.878991,"redis_calls":13,"redis_duration_s":0.002309,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001485,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011726,"completed_at":"2026-10-26T21:33:38.253Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 154.504264] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42c2e65cef42a6e29cdb3143","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42c2e65cef42a6e29cdb3143: start","job_status":"start","queue_duration_s":0.891639,"scheduling_latency_s":0.891652}1454gitlab # [ 154.519102] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42c2e65cef42a6e29cdb3143","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42c2e65cef42a6e29cdb3143: done: 0.010961 sec","job_status":"done","queue_duration_s":0.891639,"scheduling_latency_s":0.891652,"redis_calls":13,"redis_duration_s":0.001698,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010961,"completed_at":"2026-10-26T21:33:38.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 154.593269] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e08ffe5a91d1babe833cc64","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e08ffe5a91d1babe833cc64: start","job_status":"start","queue_duration_s":0.903576,"scheduling_latency_s":0.903591}1456gitlab # [ 154.594482] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e08ffe5a91d1babe833cc64","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e08ffe5a91d1babe833cc64: done: 0.010767 sec","job_status":"done","queue_duration_s":0.903576,"scheduling_latency_s":0.903591,"redis_calls":13,"redis_duration_s":0.001644,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010767,"completed_at":"2026-10-26T21:33:38.277Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 154.650759] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b08e2c6504c8149feeff3c3","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b08e2c6504c8149feeff3c3: start","job_status":"start","queue_duration_s":0.915451,"scheduling_latency_s":0.915465}1458gitlab # [ 154.651792] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b08e2c6504c8149feeff3c3","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b08e2c6504c8149feeff3c3: done: 0.010597 sec","job_status":"done","queue_duration_s":0.915451,"scheduling_latency_s":0.915465,"redis_calls":13,"redis_duration_s":0.0017490000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010597,"completed_at":"2026-10-26T21:33:38.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 154.712685] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fc70dd9cea41fb427aee761","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fc70dd9cea41fb427aee761: start","job_status":"start","queue_duration_s":0.927107,"scheduling_latency_s":0.927121}1460gitlab # [ 154.713918] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fc70dd9cea41fb427aee761","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fc70dd9cea41fb427aee761: done: 0.011014 sec","job_status":"done","queue_duration_s":0.927107,"scheduling_latency_s":0.927121,"redis_calls":13,"redis_duration_s":0.0016649999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011014,"completed_at":"2026-10-26T21:33:38.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 154.769942] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09268b8f9ba69c98231bae8a","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09268b8f9ba69c98231bae8a: start","job_status":"start","queue_duration_s":0.939263,"scheduling_latency_s":0.939277}1462gitlab # [ 154.776140] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09268b8f9ba69c98231bae8a","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09268b8f9ba69c98231bae8a: done: 0.010849 sec","job_status":"done","queue_duration_s":0.939263,"scheduling_latency_s":0.939277,"redis_calls":13,"redis_duration_s":0.002071,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010849,"completed_at":"2026-10-26T21:33:38.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 154.819262] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a18780afbdc86d9445c88393","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a18780afbdc86d9445c88393: start","job_status":"start","queue_duration_s":0.951313,"scheduling_latency_s":0.951327}1464gitlab # [ 154.832110] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a18780afbdc86d9445c88393","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a18780afbdc86d9445c88393: done: 0.01063 sec","job_status":"done","queue_duration_s":0.951313,"scheduling_latency_s":0.951327,"redis_calls":13,"redis_duration_s":0.001754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01063,"completed_at":"2026-10-26T21:33:38.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 154.900266] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58b37cb15c68667d8e99853e","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58b37cb15c68667d8e99853e: start","job_status":"start","queue_duration_s":0.963088,"scheduling_latency_s":0.963101}1466gitlab # [ 154.901191] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58b37cb15c68667d8e99853e","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58b37cb15c68667d8e99853e: done: 0.010667 sec","job_status":"done","queue_duration_s":0.963088,"scheduling_latency_s":0.963101,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000607,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010667,"completed_at":"2026-10-26T21:33:38.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 154.955621] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0c7a97b750d7c10a3744ac8","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0c7a97b750d7c10a3744ac8: start","job_status":"start","queue_duration_s":0.974801,"scheduling_latency_s":0.974815}1468gitlab # [ 154.956487] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0c7a97b750d7c10a3744ac8","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0c7a97b750d7c10a3744ac8: done: 0.010519 sec","job_status":"done","queue_duration_s":0.974801,"scheduling_latency_s":0.974815,"redis_calls":13,"redis_duration_s":0.0016650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010519,"completed_at":"2026-10-26T21:33:38.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 155.013213] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a8beb618aae9dd61c32c63e","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a8beb618aae9dd61c32c63e: start","job_status":"start","queue_duration_s":0.986442,"scheduling_latency_s":0.986456}1470gitlab # [ 155.014037] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a8beb618aae9dd61c32c63e","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a8beb618aae9dd61c32c63e: done: 0.01069 sec","job_status":"done","queue_duration_s":0.986442,"scheduling_latency_s":0.986456,"redis_calls":13,"redis_duration_s":0.001746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01069,"completed_at":"2026-10-26T21:33:38.359Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 155.027668] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abbb71efa1fb762c99e28a75","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abbb71efa1fb762c99e28a75: start","job_status":"start","queue_duration_s":0.998051,"scheduling_latency_s":0.998065}1472gitlab # [ 155.083156] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abbb71efa1fb762c99e28a75","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abbb71efa1fb762c99e28a75: done: 0.010766 sec","job_status":"done","queue_duration_s":0.998051,"scheduling_latency_s":0.998065,"redis_calls":13,"redis_duration_s":0.0017540000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010766,"completed_at":"2026-10-26T21:33:38.371Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 155.084515] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86c8b293121846f32cf611b1","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86c8b293121846f32cf611b1: start","job_status":"start","queue_duration_s":1.00976,"scheduling_latency_s":1.009773}1474gitlab # [ 155.092198] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86c8b293121846f32cf611b1","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86c8b293121846f32cf611b1: done: 0.01068 sec","job_status":"done","queue_duration_s":1.00976,"scheduling_latency_s":1.009773,"redis_calls":13,"redis_duration_s":0.0016719999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01068,"completed_at":"2026-10-26T21:33:38.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 155.167203] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b538dcdcb26b41a23fbdba0","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b538dcdcb26b41a23fbdba0: start","job_status":"start","queue_duration_s":1.021309,"scheduling_latency_s":1.021323}1476gitlab # [ 155.168092] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b538dcdcb26b41a23fbdba0","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b538dcdcb26b41a23fbdba0: done: 0.010783 sec","job_status":"done","queue_duration_s":1.021309,"scheduling_latency_s":1.021323,"redis_calls":13,"redis_duration_s":0.001778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010783,"completed_at":"2026-10-26T21:33:38.394Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 155.186425] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"680805f01b64c022933a3950","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-680805f01b64c022933a3950: start","job_status":"start","queue_duration_s":1.033242,"scheduling_latency_s":1.033256}1478gitlab # [ 155.234694] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"680805f01b64c022933a3950","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-680805f01b64c022933a3950: done: 0.010571 sec","job_status":"done","queue_duration_s":1.033242,"scheduling_latency_s":1.033256,"redis_calls":13,"redis_duration_s":0.0017499999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010571,"completed_at":"2026-10-26T21:33:38.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 155.238730] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f923440b4c1d5efa6df3a558","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f923440b4c1d5efa6df3a558: start","job_status":"start","queue_duration_s":1.044883,"scheduling_latency_s":1.044896}1480gitlab # [ 155.282821] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:33:38.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f923440b4c1d5efa6df3a558","created_at":"2026-10-26T21:33:37.305Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-0d53b69276c8445d","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6fe6fc4adbc842e3524ae6bf88b8246f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:33:37.362Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f923440b4c1d5efa6df3a558: done: 0.010824 sec","job_status":"done","queue_duration_s":1.044883,"scheduling_latency_s":1.044896,"redis_calls":13,"redis_duration_s":0.001701,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010824,"completed_at":"2026-10-26T21:33:38.418Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 155.490730] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 3056981833 wd_nsec: 30569802391482gitlab # [ 175.961804] setup-gitlab-start[2319]: W, [2026-10-26T21:34:02.057823 #2319] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1483gitlab # [ 177.671851] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:03.767Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"24dcc8aa9fec1a3bbf6cf674","created_at":"2026-10-26T21:34:03.706Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab1548a0b59c5a7f2b75d1b5605cf1a1","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.763Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-24dcc8aa9fec1a3bbf6cf674: start","job_status":"start","queue_duration_s":0.003439,"scheduling_latency_s":0.003501}1484gitlab # [ 177.861034] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:03.957Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"24dcc8aa9fec1a3bbf6cf674","created_at":"2026-10-26T21:34:03.706Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab1548a0b59c5a7f2b75d1b5605cf1a1","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.763Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-24dcc8aa9fec1a3bbf6cf674: done: 0.190072 sec","job_status":"done","queue_duration_s":0.003439,"scheduling_latency_s":0.003501,"redis_calls":7,"redis_duration_s":0.013745,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002795,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.063,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.190072,"completed_at":"2026-10-26T21:34:03.957Z","load_balancing_strategy":"primary","db_duration_s":0.089195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 177.942368] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.038Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"24d64c7f1a1096fd2d28318c","created_at":"2026-10-26T21:34:03.834Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bab688812dd34ea69034a7439b6890ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.842Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-24d64c7f1a1096fd2d28318c: start","job_status":"start","queue_duration_s":0.195681,"scheduling_latency_s":0.195742}1486gitlab # [ 178.377925] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"24d64c7f1a1096fd2d28318c","created_at":"2026-10-26T21:34:03.834Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bab688812dd34ea69034a7439b6890ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.842Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-24d64c7f1a1096fd2d28318c: done: 0.436114 sec","job_status":"done","queue_duration_s":0.195681,"scheduling_latency_s":0.195742,"redis_calls":11,"redis_duration_s":0.017167,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002997,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001552,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.012618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.123,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.123,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.204315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001331734,"exclusive_lock_hold_duration_s":0.359423894,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.436114,"completed_at":"2026-10-26T21:34:04.474Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.216946,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 178.427077] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"05a8348a9581560a0251b316","created_at":"2026-10-26T21:34:03.863Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0bef1435f8ec45c918cb86ae10b990e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.873Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-05a8348a9581560a0251b316: start","job_status":"start","queue_duration_s":0.65079,"scheduling_latency_s":0.65082}1488gitlab # [ 178.451677] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.548Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1489gitlab # [ 178.458620] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"05a8348a9581560a0251b316","created_at":"2026-10-26T21:34:03.863Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0bef1435f8ec45c918cb86ae10b990e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.873Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-05a8348a9581560a0251b316: done: 0.03139 sec","job_status":"done","queue_duration_s":0.65079,"scheduling_latency_s":0.65082,"redis_calls":7,"redis_duration_s":0.002099,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001543,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03139,"completed_at":"2026-10-26T21:34:04.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 178.502806] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f9ccff5295288b116c65ff1d","created_at":"2026-10-26T21:34:03.884Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dedb319a61ad0aa93ae772296186a6bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.887Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f9ccff5295288b116c65ff1d: start","job_status":"start","queue_duration_s":0.711525,"scheduling_latency_s":0.711563}1491gitlab # [ 178.536649] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f9ccff5295288b116c65ff1d","created_at":"2026-10-26T21:34:03.884Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dedb319a61ad0aa93ae772296186a6bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.887Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f9ccff5295288b116c65ff1d: done: 0.033849 sec","job_status":"done","queue_duration_s":0.711525,"scheduling_latency_s":0.711563,"redis_calls":14,"redis_duration_s":0.00449,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000543,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002624,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033849,"completed_at":"2026-10-26T21:34:04.633Z","load_balancing_strategy":"primary","db_duration_s":0.005002,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 178.539761] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.636Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"11cf7dec410e828b6987d1c2","created_at":"2026-10-26T21:34:03.894Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c72f4ba90b52a50361e8d707444b1bc7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-26T21:34:03.897Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-11cf7dec410e828b6987d1c2: start","job_status":"start","queue_duration_s":0.739259,"scheduling_latency_s":0.739285}1493gitlab # [ 178.566307] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"11cf7dec410e828b6987d1c2","created_at":"2026-10-26T21:34:03.894Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c72f4ba90b52a50361e8d707444b1bc7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-26T21:34:03.897Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-11cf7dec410e828b6987d1c2: done: 0.026416 sec","job_status":"done","queue_duration_s":0.739259,"scheduling_latency_s":0.739285,"redis_calls":7,"redis_duration_s":0.00328,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001868,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026416,"completed_at":"2026-10-26T21:34:04.662Z","load_balancing_strategy":"primary","db_duration_s":0.003052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 178.591426] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"59f0fad8ffcff9b1b042662f","created_at":"2026-10-26T21:34:03.900Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc1526160883f55f30f5a830796ea79d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.902Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-59f0fad8ffcff9b1b042662f: start","job_status":"start","queue_duration_s":0.767586,"scheduling_latency_s":0.767606}1495gitlab # [ 178.607676] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.678Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1496gitlab # [ 178.611349] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.683Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"59f0fad8ffcff9b1b042662f","created_at":"2026-10-26T21:34:03.900Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc1526160883f55f30f5a830796ea79d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.902Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-59f0fad8ffcff9b1b042662f: done: 0.013884 sec","job_status":"done","queue_duration_s":0.767586,"scheduling_latency_s":0.767606,"redis_calls":7,"redis_duration_s":0.004803,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001735,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013884,"completed_at":"2026-10-26T21:34:04.683Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 178.672673] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.686Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"cc7119cb2e66a394263b2036","created_at":"2026-10-26T21:34:03.911Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5faffce64a6cbce2c2f394569694e35f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-26T21:34:03.914Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-cc7119cb2e66a394263b2036: start","job_status":"start","queue_duration_s":0.772498,"scheduling_latency_s":0.772515}1498gitlab # [ 178.673585] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.694Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1499gitlab # [ 178.674126] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"cc7119cb2e66a394263b2036","created_at":"2026-10-26T21:34:03.911Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5faffce64a6cbce2c2f394569694e35f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-26T21:34:03.914Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-cc7119cb2e66a394263b2036: done: 0.012745 sec","job_status":"done","queue_duration_s":0.772498,"scheduling_latency_s":0.772515,"redis_calls":7,"redis_duration_s":0.00415,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012745,"completed_at":"2026-10-26T21:34:04.699Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 178.724794] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.702Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e5ba46f550f00e9f7d48528f","created_at":"2026-10-26T21:34:03.928Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6a80a7e7feee27f15e0d64f0e1f8126","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.943Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e5ba46f550f00e9f7d48528f: start","job_status":"start","queue_duration_s":0.759492,"scheduling_latency_s":0.759508}1501gitlab # [ 178.771123] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.730Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e5ba46f550f00e9f7d48528f","created_at":"2026-10-26T21:34:03.928Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6a80a7e7feee27f15e0d64f0e1f8126","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:03.943Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e5ba46f550f00e9f7d48528f: done: 0.027683 sec","job_status":"done","queue_duration_s":0.759492,"scheduling_latency_s":0.759508,"redis_calls":10,"redis_duration_s":0.004639,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000881,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276292,"duration_s":0.027683,"completed_at":"2026-10-26T21:34:04.730Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 178.772939] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.731Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"dfc5299d32281fe378f323b8","created_at":"2026-10-26T21:34:03.950Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98091330c7466451c5fa1fac94e9e6da","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.037Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-dfc5299d32281fe378f323b8: start","job_status":"start","queue_duration_s":0.694317,"scheduling_latency_s":0.694333}1503gitlab # [ 178.787310] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"dfc5299d32281fe378f323b8","created_at":"2026-10-26T21:34:03.950Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98091330c7466451c5fa1fac94e9e6da","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.037Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-dfc5299d32281fe378f323b8: done: 0.019675 sec","job_status":"done","queue_duration_s":0.694317,"scheduling_latency_s":0.694333,"redis_calls":12,"redis_duration_s":0.0032389999999999997,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000479,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001442,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001318,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000462628,"exclusive_lock_hold_duration_s":0.0045561659999999995,"duration_s":0.019675,"completed_at":"2026-10-26T21:34:04.751Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 178.840870] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7fbe332c8d1d7305ab19a77d","created_at":"2026-10-26T21:34:04.054Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2459c8475abea1fbfeed83a143575979","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.058Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7fbe332c8d1d7305ab19a77d: start","job_status":"start","queue_duration_s":0.694902,"scheduling_latency_s":0.694916}1505gitlab # [ 178.841686] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7fbe332c8d1d7305ab19a77d","created_at":"2026-10-26T21:34:04.054Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2459c8475abea1fbfeed83a143575979","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.058Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7fbe332c8d1d7305ab19a77d: done: 0.094019 sec","job_status":"done","queue_duration_s":0.694902,"scheduling_latency_s":0.694916,"redis_calls":9,"redis_duration_s":0.002129,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001139,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.075,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.075,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000984762,"exclusive_lock_hold_duration_s":0.010058262,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.094019,"completed_at":"2026-10-26T21:34:04.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.075759,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 178.884688] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.848Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f51a0c5909aaca2371046e24","created_at":"2026-10-26T21:34:04.064Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41f662066e4d99867662e6f65fdba830","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.073Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f51a0c5909aaca2371046e24: start","job_status":"start","queue_duration_s":0.77477,"scheduling_latency_s":0.774786}1507gitlab # [ 178.890634] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.857Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f51a0c5909aaca2371046e24","created_at":"2026-10-26T21:34:04.064Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41f662066e4d99867662e6f65fdba830","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.073Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f51a0c5909aaca2371046e24: done: 0.009589 sec","job_status":"done","queue_duration_s":0.77477,"scheduling_latency_s":0.774786,"redis_calls":7,"redis_duration_s":0.001109,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009589,"completed_at":"2026-10-26T21:34:04.857Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 178.952958] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:04.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3303096d00accc5a1595a5d0","created_at":"2026-10-26T21:34:04.099Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af9849f714435dc0486051e96284320e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.108Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3303096d00accc5a1595a5d0: start","job_status":"start","queue_duration_s":0.750831,"scheduling_latency_s":0.750844}1509gitlab # [ 179.157182] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.253Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3303096d00accc5a1595a5d0","created_at":"2026-10-26T21:34:04.099Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af9849f714435dc0486051e96284320e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.108Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3303096d00accc5a1595a5d0: done: 0.394716 sec","job_status":"done","queue_duration_s":0.750831,"scheduling_latency_s":0.750844,"redis_calls":562,"redis_duration_s":0.110917,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.109704,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.307971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.394716,"completed_at":"2026-10-26T21:34:05.253Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 179.243266] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"903048e9a6bbd93cc91d7f66","created_at":"2026-10-26T21:34:04.123Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0614e33b9c16a0c6eb24878c52657fd","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.129Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-903048e9a6bbd93cc91d7f66: start","job_status":"start","queue_duration_s":1.210238,"scheduling_latency_s":1.210293}1511gitlab # [ 179.287225] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"903048e9a6bbd93cc91d7f66","created_at":"2026-10-26T21:34:04.123Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0614e33b9c16a0c6eb24878c52657fd","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.129Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-903048e9a6bbd93cc91d7f66: done: 0.043953 sec","job_status":"done","queue_duration_s":1.210238,"scheduling_latency_s":1.210293,"redis_calls":9,"redis_duration_s":0.00287,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001589,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000997333,"exclusive_lock_hold_duration_s":0.006171734,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.043953,"completed_at":"2026-10-26T21:34:05.383Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 179.348704] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.444Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a533088598b65d8b4b50541f","created_at":"2026-10-26T21:34:04.141Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a12b70fa3ef2ee5603a2295dd0f15ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.146Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a533088598b65d8b4b50541f: start","job_status":"start","queue_duration_s":1.298483,"scheduling_latency_s":1.298546}1513gitlab # [ 179.386681] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.481Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a533088598b65d8b4b50541f","created_at":"2026-10-26T21:34:04.141Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a12b70fa3ef2ee5603a2295dd0f15ddd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.146Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a533088598b65d8b4b50541f: done: 0.037153 sec","job_status":"done","queue_duration_s":1.298483,"scheduling_latency_s":1.298546,"redis_calls":7,"redis_duration_s":0.002556,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001871,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000685,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037153,"completed_at":"2026-10-26T21:34:05.481Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 179.434415] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"063e69ce8771e8eee730f8d3","created_at":"2026-10-26T21:34:04.167Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.171Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-063e69ce8771e8eee730f8d3: start","job_status":"start","queue_duration_s":1.358701,"scheduling_latency_s":1.35876}1515gitlab # [ 179.530668] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"063e69ce8771e8eee730f8d3","created_at":"2026-10-26T21:34:04.167Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.171Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-063e69ce8771e8eee730f8d3: done: 0.096732 sec","job_status":"done","queue_duration_s":1.358701,"scheduling_latency_s":1.35876,"redis_calls":60,"redis_duration_s":0.015299,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.001044,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013316,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.096732,"completed_at":"2026-10-26T21:34:05.627Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 179.614088] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.710Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1b8b92f5fe6fea11032d958d","created_at":"2026-10-26T21:34:04.184Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b9a832a62232622847cb14094756e03","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.188Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1b8b92f5fe6fea11032d958d: start","job_status":"start","queue_duration_s":1.52212,"scheduling_latency_s":1.52218}1517gitlab # [ 179.626926] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.723Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1518gitlab # [ 179.637538] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1b8b92f5fe6fea11032d958d","created_at":"2026-10-26T21:34:04.184Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b9a832a62232622847cb14094756e03","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.188Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1b8b92f5fe6fea11032d958d: done: 0.023552 sec","job_status":"done","queue_duration_s":1.52212,"scheduling_latency_s":1.52218,"redis_calls":7,"redis_duration_s":0.003393,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023552,"completed_at":"2026-10-26T21:34:05.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 179.684763] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.780Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"42162af33d20b4e9e70ff496","created_at":"2026-10-26T21:34:04.210Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c522becc4589c0ef3ac693d241344c37","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.221Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-42162af33d20b4e9e70ff496: start","job_status":"start","queue_duration_s":1.55965,"scheduling_latency_s":1.559701}1520gitlab # [ 179.716754] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.812Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"42162af33d20b4e9e70ff496","created_at":"2026-10-26T21:34:04.210Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c522becc4589c0ef3ac693d241344c37","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.221Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-42162af33d20b4e9e70ff496: done: 0.032272 sec","job_status":"done","queue_duration_s":1.55965,"scheduling_latency_s":1.559701,"redis_calls":12,"redis_duration_s":0.003884,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000797,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000636,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001852,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000599,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000583315,"duration_s":0.032272,"completed_at":"2026-10-26T21:34:05.812Z","load_balancing_strategy":"primary","db_duration_s":0.000968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 179.720271] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.816Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5ebaca6f6e2aa105f22cfd01","created_at":"2026-10-26T21:34:04.232Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8746a5f825fc2806cb0e5f4dc3b8055b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-26T21:34:04.235Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5ebaca6f6e2aa105f22cfd01: start","job_status":"start","queue_duration_s":1.58097,"scheduling_latency_s":1.581001}1522gitlab # [ 179.735241] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.832Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1523gitlab # [ 179.743420] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.839Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5ebaca6f6e2aa105f22cfd01","created_at":"2026-10-26T21:34:04.232Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8746a5f825fc2806cb0e5f4dc3b8055b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-26T21:34:04.235Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5ebaca6f6e2aa105f22cfd01: done: 0.022961 sec","job_status":"done","queue_duration_s":1.58097,"scheduling_latency_s":1.581001,"redis_calls":7,"redis_duration_s":0.003444,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001955,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001489,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022961,"completed_at":"2026-10-26T21:34:05.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 179.778456] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ca64b8cc595b4d13fd88e5e6","created_at":"2026-10-26T21:34:04.251Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b757ea5bfda1ffbaa5678718ffe3fdac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.254Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ca64b8cc595b4d13fd88e5e6: start","job_status":"start","queue_duration_s":1.592218,"scheduling_latency_s":1.59225}1525gitlab # [ 179.793295] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ca64b8cc595b4d13fd88e5e6","created_at":"2026-10-26T21:34:04.251Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b757ea5bfda1ffbaa5678718ffe3fdac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.254Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ca64b8cc595b4d13fd88e5e6: done: 0.029452 sec","job_status":"done","queue_duration_s":1.592218,"scheduling_latency_s":1.59225,"redis_calls":9,"redis_duration_s":0.006384,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00311,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001706362,"exclusive_lock_hold_duration_s":0.006113068,"duration_s":0.029452,"completed_at":"2026-10-26T21:34:05.876Z","load_balancing_strategy":"primary","db_duration_s":0.003473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 179.856915] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.879Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"994d00562d126d48eca87501","created_at":"2026-10-26T21:34:04.267Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1261de44a6772898fa71cc95f5d9ca42","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.272Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-994d00562d126d48eca87501: start","job_status":"start","queue_duration_s":1.607228,"scheduling_latency_s":1.607254}1527gitlab # [ 179.857799] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.892Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1528gitlab # [ 179.858671] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"994d00562d126d48eca87501","created_at":"2026-10-26T21:34:04.267Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1261de44a6772898fa71cc95f5d9ca42","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.272Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-994d00562d126d48eca87501: done: 0.019363 sec","job_status":"done","queue_duration_s":1.607228,"scheduling_latency_s":1.607254,"redis_calls":7,"redis_duration_s":0.0045769999999999995,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001288,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019363,"completed_at":"2026-10-26T21:34:05.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 179.918720] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.902Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"09d09cbcb1b45683ba08994b","created_at":"2026-10-26T21:34:04.292Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b802560214b97fd89071b33ba7fe69f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.295Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-09d09cbcb1b45683ba08994b: start","job_status":"start","queue_duration_s":1.607021,"scheduling_latency_s":1.607048}1530gitlab # [ 179.919499] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.925Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"09d09cbcb1b45683ba08994b","created_at":"2026-10-26T21:34:04.292Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b802560214b97fd89071b33ba7fe69f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.295Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-09d09cbcb1b45683ba08994b: done: 0.022967 sec","job_status":"done","queue_duration_s":1.607021,"scheduling_latency_s":1.607048,"redis_calls":7,"redis_duration_s":0.003625,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001409,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002216,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022967,"completed_at":"2026-10-26T21:34:05.925Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 179.951146] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a67126f6d8d8443fb37990c2","created_at":"2026-10-26T21:34:04.312Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"159661e51468818380c72ea71bd187da","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.324Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a67126f6d8d8443fb37990c2: start","job_status":"start","queue_duration_s":1.603418,"scheduling_latency_s":1.603455}1532gitlab # [ 179.965762] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a67126f6d8d8443fb37990c2","created_at":"2026-10-26T21:34:04.312Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"159661e51468818380c72ea71bd187da","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.324Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a67126f6d8d8443fb37990c2: done: 0.026541 sec","job_status":"done","queue_duration_s":1.603418,"scheduling_latency_s":1.603455,"redis_calls":10,"redis_duration_s":0.004169,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003117,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006176203,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.026541,"completed_at":"2026-10-26T21:34:05.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00216,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1533gitlab # [ 180.021732] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:05.957Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"51a6da2b9e2d3860a58f2569","created_at":"2026-10-26T21:34:04.342Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1db58de91b28abc25643032562cee9bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.347Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-51a6da2b9e2d3860a58f2569: start","job_status":"start","queue_duration_s":1.610028,"scheduling_latency_s":1.610053}1534gitlab # [ 180.117558] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"51a6da2b9e2d3860a58f2569","created_at":"2026-10-26T21:34:04.342Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1db58de91b28abc25643032562cee9bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.347Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-51a6da2b9e2d3860a58f2569: done: 0.255893 sec","job_status":"done","queue_duration_s":1.610028,"scheduling_latency_s":1.610053,"redis_calls":9,"redis_duration_s":0.0029890000000000003,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001572,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000517385,"exclusive_lock_hold_duration_s":0.232362773,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.255893,"completed_at":"2026-10-26T21:34:06.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.217688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 180.166541] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c6d17d83e08229a8b6d4729f","created_at":"2026-10-26T21:34:04.360Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72269d606789568acf5d145baf0c8528","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.364Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c6d17d83e08229a8b6d4729f: start","job_status":"start","queue_duration_s":1.898767,"scheduling_latency_s":1.898831}1536gitlab # [ 180.205441] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c6d17d83e08229a8b6d4729f","created_at":"2026-10-26T21:34:04.360Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-80dc7c42294b440c","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72269d606789568acf5d145baf0c8528","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.364Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c6d17d83e08229a8b6d4729f: done: 0.038979 sec","job_status":"done","queue_duration_s":1.898767,"scheduling_latency_s":1.898831,"redis_calls":7,"redis_duration_s":0.002032,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001395,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000637,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038979,"completed_at":"2026-10-26T21:34:06.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 180.246049] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.342Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c98a4fda608589d6608f5eca","created_at":"2026-10-26T21:34:04.617Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-8a9954942a514581","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dedb319a61ad0aa93ae772296186a6bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.626Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c98a4fda608589d6608f5eca: start","job_status":"start","queue_duration_s":1.715611,"scheduling_latency_s":1.715673}1538gitlab # [ 180.278130] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.374Z","message":"No existing merge request to be cleaned up."}1539gitlab # [ 180.296525] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.391Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c98a4fda608589d6608f5eca","created_at":"2026-10-26T21:34:04.617Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-8a9954942a514581","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dedb319a61ad0aa93ae772296186a6bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.626Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c98a4fda608589d6608f5eca: done: 0.049533 sec","job_status":"done","queue_duration_s":1.715611,"scheduling_latency_s":1.715673,"redis_calls":10,"redis_duration_s":0.004536999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003364,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049533,"completed_at":"2026-10-26T21:34:06.391Z","load_balancing_strategy":"primary","db_duration_s":0.003932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 180.335164] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.431Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6da7aba9fc0dc3e8303297f5","created_at":"2026-10-26T21:34:04.617Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-8a9954942a514581","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dedb319a61ad0aa93ae772296186a6bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.626Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6da7aba9fc0dc3e8303297f5: start","job_status":"start","queue_duration_s":1.804607,"scheduling_latency_s":1.804668}1541gitlab # [ 180.365485] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.462Z","message":"No existing merge request to be cleaned up."}1542gitlab # [ 180.383792] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.479Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6da7aba9fc0dc3e8303297f5","created_at":"2026-10-26T21:34:04.617Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-8a9954942a514581","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dedb319a61ad0aa93ae772296186a6bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.626Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6da7aba9fc0dc3e8303297f5: done: 0.048584 sec","job_status":"done","queue_duration_s":1.804607,"scheduling_latency_s":1.804668,"redis_calls":10,"redis_duration_s":0.004255999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003132,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048584,"completed_at":"2026-10-26T21:34:06.479Z","load_balancing_strategy":"primary","db_duration_s":0.003531,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 180.422600] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.518Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3c551a479b8d9d7c4d5e80e1","created_at":"2026-10-26T21:34:04.617Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-8a9954942a514581","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dedb319a61ad0aa93ae772296186a6bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.626Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3c551a479b8d9d7c4d5e80e1: start","job_status":"start","queue_duration_s":1.892009,"scheduling_latency_s":1.892072}1544gitlab # [ 180.453520] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.550Z","message":"No existing merge request to be cleaned up."}1545gitlab # [ 180.472165] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.568Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3c551a479b8d9d7c4d5e80e1","created_at":"2026-10-26T21:34:04.617Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-8a9954942a514581","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dedb319a61ad0aa93ae772296186a6bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.626Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3c551a479b8d9d7c4d5e80e1: done: 0.049528 sec","job_status":"done","queue_duration_s":1.892009,"scheduling_latency_s":1.892072,"redis_calls":10,"redis_duration_s":0.0048579999999999995,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003597,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049528,"completed_at":"2026-10-26T21:34:06.568Z","load_balancing_strategy":"primary","db_duration_s":0.002894,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 180.511847] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.608Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a9574994908623a0a359d27b","created_at":"2026-10-26T21:34:04.617Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-8a9954942a514581","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dedb319a61ad0aa93ae772296186a6bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.626Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a9574994908623a0a359d27b: start","job_status":"start","queue_duration_s":1.981266,"scheduling_latency_s":1.981331}1547gitlab # [ 180.541816] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.638Z","message":"No existing merge request to be cleaned up."}1548gitlab # [ 180.559526] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.655Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a9574994908623a0a359d27b","created_at":"2026-10-26T21:34:04.617Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-8a9954942a514581","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dedb319a61ad0aa93ae772296186a6bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:04.626Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a9574994908623a0a359d27b: done: 0.047694 sec","job_status":"done","queue_duration_s":1.981266,"scheduling_latency_s":1.981331,"redis_calls":10,"redis_duration_s":0.004558,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003455,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047694,"completed_at":"2026-10-26T21:34:06.655Z","load_balancing_strategy":"primary","db_duration_s":0.002498,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 180.599134] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dc6473a0e290eb0b560e19f","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dc6473a0e290eb0b560e19f: start","job_status":"start","queue_duration_s":1.076735,"scheduling_latency_s":1.076802}1550gitlab # [ 180.639763] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dc6473a0e290eb0b560e19f","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dc6473a0e290eb0b560e19f: done: 0.040676 sec","job_status":"done","queue_duration_s":1.076735,"scheduling_latency_s":1.076802,"redis_calls":13,"redis_duration_s":0.003177,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040676,"completed_at":"2026-10-26T21:34:06.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 180.679889] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04fbd807895e45e3ecaef526","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04fbd807895e45e3ecaef526: start","job_status":"start","queue_duration_s":1.157764,"scheduling_latency_s":1.157815}1552gitlab # [ 180.708515] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04fbd807895e45e3ecaef526","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04fbd807895e45e3ecaef526: done: 0.027891 sec","job_status":"done","queue_duration_s":1.157764,"scheduling_latency_s":1.157815,"redis_calls":13,"redis_duration_s":0.004865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003272,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027891,"completed_at":"2026-10-26T21:34:06.803Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 180.747414] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e488d196fba3c27297661e08","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e488d196fba3c27297661e08: start","job_status":"start","queue_duration_s":1.225337,"scheduling_latency_s":1.225382}1554gitlab # [ 180.775058] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e488d196fba3c27297661e08","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e488d196fba3c27297661e08: done: 0.026899 sec","job_status":"done","queue_duration_s":1.225337,"scheduling_latency_s":1.225382,"redis_calls":13,"redis_duration_s":0.004328,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002822,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026899,"completed_at":"2026-10-26T21:34:06.870Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 180.779219] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1735777819664fc280573957","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1735777819664fc280573957: start","job_status":"start","queue_duration_s":1.257334,"scheduling_latency_s":1.257369}1556gitlab # [ 180.808743] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1735777819664fc280573957","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1735777819664fc280573957: done: 0.029224 sec","job_status":"done","queue_duration_s":1.257334,"scheduling_latency_s":1.257369,"redis_calls":13,"redis_duration_s":0.0070940000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001413,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005681,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029224,"completed_at":"2026-10-26T21:34:06.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 180.822075] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f1a8b7a766c070b87bedd0e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f1a8b7a766c070b87bedd0e: start","job_status":"start","queue_duration_s":1.293339,"scheduling_latency_s":1.293373}1558gitlab # [ 180.842648] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f1a8b7a766c070b87bedd0e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f1a8b7a766c070b87bedd0e: done: 0.02731 sec","job_status":"done","queue_duration_s":1.293339,"scheduling_latency_s":1.293373,"redis_calls":13,"redis_duration_s":0.008118,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006294,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02731,"completed_at":"2026-10-26T21:34:06.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 180.911670] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfaf8af86f25f6c75f0c519b","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfaf8af86f25f6c75f0c519b: start","job_status":"start","queue_duration_s":1.32717,"scheduling_latency_s":1.327198}1560gitlab # [ 180.912806] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfaf8af86f25f6c75f0c519b","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfaf8af86f25f6c75f0c519b: done: 0.026185 sec","job_status":"done","queue_duration_s":1.32717,"scheduling_latency_s":1.327198,"redis_calls":13,"redis_duration_s":0.008552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006547,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026185,"completed_at":"2026-10-26T21:34:06.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 180.927378] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cdec0f60dce18942ccc3557","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cdec0f60dce18942ccc3557: start","job_status":"start","queue_duration_s":1.355829,"scheduling_latency_s":1.355857}1562gitlab # [ 180.940266] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cdec0f60dce18942ccc3557","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cdec0f60dce18942ccc3557: done: 0.014365 sec","job_status":"done","queue_duration_s":1.355829,"scheduling_latency_s":1.355857,"redis_calls":13,"redis_duration_s":0.0033179999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014365,"completed_at":"2026-10-26T21:34:06.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 180.989299] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:06.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f140a9f5e43f06b8f094487f","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f140a9f5e43f06b8f094487f: start","job_status":"start","queue_duration_s":1.371517,"scheduling_latency_s":1.371532}1564gitlab # [ 180.990201] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f140a9f5e43f06b8f094487f","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f140a9f5e43f06b8f094487f: done: 0.012695 sec","job_status":"done","queue_duration_s":1.371517,"scheduling_latency_s":1.371532,"redis_calls":13,"redis_duration_s":0.003191,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00227,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012695,"completed_at":"2026-10-26T21:34:07.002Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 181.030647] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20639b675e8e1823f35312ae","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20639b675e8e1823f35312ae: start","job_status":"start","queue_duration_s":1.385539,"scheduling_latency_s":1.385554}1566gitlab # [ 181.043389] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20639b675e8e1823f35312ae","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20639b675e8e1823f35312ae: done: 0.021903 sec","job_status":"done","queue_duration_s":1.385539,"scheduling_latency_s":1.385554,"redis_calls":13,"redis_duration_s":0.012242,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010457,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021903,"completed_at":"2026-10-26T21:34:07.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 181.097127] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"383f8c6f5cb5c6ffb5950367","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-383f8c6f5cb5c6ffb5950367: start","job_status":"start","queue_duration_s":1.410231,"scheduling_latency_s":1.410247}1568gitlab # [ 181.097940] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"383f8c6f5cb5c6ffb5950367","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-383f8c6f5cb5c6ffb5950367: done: 0.011558 sec","job_status":"done","queue_duration_s":1.410231,"scheduling_latency_s":1.410247,"redis_calls":13,"redis_duration_s":0.0017460000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011558,"completed_at":"2026-10-26T21:34:07.040Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 181.148271] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b4b96b9a45c189d849ad77e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b4b96b9a45c189d849ad77e: start","job_status":"start","queue_duration_s":1.423215,"scheduling_latency_s":1.42323}1570gitlab # [ 181.149962] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b4b96b9a45c189d849ad77e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b4b96b9a45c189d849ad77e: done: 0.011233 sec","job_status":"done","queue_duration_s":1.423215,"scheduling_latency_s":1.42323,"redis_calls":13,"redis_duration_s":0.001877,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011233,"completed_at":"2026-10-26T21:34:07.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 181.192915] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f690c05606278108bc99b98e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f690c05606278108bc99b98e: start","job_status":"start","queue_duration_s":1.435435,"scheduling_latency_s":1.43545}1572gitlab # [ 181.205908] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f690c05606278108bc99b98e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f690c05606278108bc99b98e: done: 0.01089 sec","job_status":"done","queue_duration_s":1.435435,"scheduling_latency_s":1.43545,"redis_calls":13,"redis_duration_s":0.001777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01089,"completed_at":"2026-10-26T21:34:07.064Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 181.279303] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c22f0b2f00925adb3fb841e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c22f0b2f00925adb3fb841e: start","job_status":"start","queue_duration_s":1.44731,"scheduling_latency_s":1.447324}1574gitlab # [ 181.280405] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c22f0b2f00925adb3fb841e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c22f0b2f00925adb3fb841e: done: 0.011091 sec","job_status":"done","queue_duration_s":1.44731,"scheduling_latency_s":1.447324,"redis_calls":13,"redis_duration_s":0.001765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011091,"completed_at":"2026-10-26T21:34:07.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 181.334789] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6522dbe762dbecc4fa16f6de","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6522dbe762dbecc4fa16f6de: start","job_status":"start","queue_duration_s":1.459917,"scheduling_latency_s":1.459931}1576gitlab # [ 181.335941] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6522dbe762dbecc4fa16f6de","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6522dbe762dbecc4fa16f6de: done: 0.010799 sec","job_status":"done","queue_duration_s":1.459917,"scheduling_latency_s":1.459931,"redis_calls":13,"redis_duration_s":0.001753,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010799,"completed_at":"2026-10-26T21:34:07.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 181.349776] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1d0cfe4361e4db461ce892d","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1d0cfe4361e4db461ce892d: start","job_status":"start","queue_duration_s":1.471673,"scheduling_latency_s":1.471687}1578gitlab # [ 181.362784] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1d0cfe4361e4db461ce892d","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1d0cfe4361e4db461ce892d: done: 0.010769 sec","job_status":"done","queue_duration_s":1.471673,"scheduling_latency_s":1.471687,"redis_calls":13,"redis_duration_s":0.002131,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001551,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010769,"completed_at":"2026-10-26T21:34:07.100Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 181.409975] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9daf67eb94afa6455a6405d","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9daf67eb94afa6455a6405d: start","job_status":"start","queue_duration_s":1.483356,"scheduling_latency_s":1.483371}1580gitlab # [ 181.412166] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9daf67eb94afa6455a6405d","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9daf67eb94afa6455a6405d: done: 0.015534 sec","job_status":"done","queue_duration_s":1.483356,"scheduling_latency_s":1.483371,"redis_calls":13,"redis_duration_s":0.0018700000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015534,"completed_at":"2026-10-26T21:34:07.117Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 181.453066] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1394ea9da05f5bc058ef4a28","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1394ea9da05f5bc058ef4a28: start","job_status":"start","queue_duration_s":1.499957,"scheduling_latency_s":1.499974}1582gitlab # [ 181.504138] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1394ea9da05f5bc058ef4a28","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1394ea9da05f5bc058ef4a28: done: 0.011232 sec","job_status":"done","queue_duration_s":1.499957,"scheduling_latency_s":1.499974,"redis_calls":13,"redis_duration_s":0.001767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001228,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011232,"completed_at":"2026-10-26T21:34:07.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 181.505597] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaa551c02ecde4c1b0d1abe0","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaa551c02ecde4c1b0d1abe0: start","job_status":"start","queue_duration_s":1.512142,"scheduling_latency_s":1.512156}1584gitlab # [ 181.553295] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaa551c02ecde4c1b0d1abe0","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaa551c02ecde4c1b0d1abe0: done: 0.010847 sec","job_status":"done","queue_duration_s":1.512142,"scheduling_latency_s":1.512156,"redis_calls":13,"redis_duration_s":0.001729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010847,"completed_at":"2026-10-26T21:34:07.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 181.554990] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1eda006ae6ddc546b1998748","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1eda006ae6ddc546b1998748: start","job_status":"start","queue_duration_s":1.524089,"scheduling_latency_s":1.524104}1586gitlab # [ 181.562490] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1eda006ae6ddc546b1998748","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1eda006ae6ddc546b1998748: done: 0.012407 sec","job_status":"done","queue_duration_s":1.524089,"scheduling_latency_s":1.524104,"redis_calls":13,"redis_duration_s":0.002034,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001375,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012407,"completed_at":"2026-10-26T21:34:07.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 181.621854] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da9924631be5e4941857f4ea","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da9924631be5e4941857f4ea: start","job_status":"start","queue_duration_s":1.537679,"scheduling_latency_s":1.537697}1588gitlab # [ 181.622944] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da9924631be5e4941857f4ea","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da9924631be5e4941857f4ea: done: 0.012699 sec","job_status":"done","queue_duration_s":1.537679,"scheduling_latency_s":1.537697,"redis_calls":13,"redis_duration_s":0.001963,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012699,"completed_at":"2026-10-26T21:34:07.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 181.653259] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf16a7e2b230ead3d851ff2f","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf16a7e2b230ead3d851ff2f: start","job_status":"start","queue_duration_s":1.551963,"scheduling_latency_s":1.551982}1590gitlab # [ 181.665790] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf16a7e2b230ead3d851ff2f","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf16a7e2b230ead3d851ff2f: done: 0.014608 sec","job_status":"done","queue_duration_s":1.551963,"scheduling_latency_s":1.551982,"redis_calls":13,"redis_duration_s":0.002127,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001288,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014608,"completed_at":"2026-10-26T21:34:07.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 181.734155] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"747940f2c64bb2dd5df7786f","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-747940f2c64bb2dd5df7786f: start","job_status":"start","queue_duration_s":1.567781,"scheduling_latency_s":1.567802}1592gitlab # [ 181.735178] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"747940f2c64bb2dd5df7786f","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-747940f2c64bb2dd5df7786f: done: 0.013444 sec","job_status":"done","queue_duration_s":1.567781,"scheduling_latency_s":1.567802,"redis_calls":13,"redis_duration_s":0.0019590000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001368,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013444,"completed_at":"2026-10-26T21:34:07.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 181.754772] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"957451989b17edd255f5e89f","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-957451989b17edd255f5e89f: start","job_status":"start","queue_duration_s":1.582292,"scheduling_latency_s":1.58231}1594gitlab # [ 181.767921] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"957451989b17edd255f5e89f","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-957451989b17edd255f5e89f: done: 0.011999 sec","job_status":"done","queue_duration_s":1.582292,"scheduling_latency_s":1.58231,"redis_calls":13,"redis_duration_s":0.001898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011999,"completed_at":"2026-10-26T21:34:07.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 181.823704] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"474c4046c827ebf4703045eb","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-474c4046c827ebf4703045eb: start","job_status":"start","queue_duration_s":1.595774,"scheduling_latency_s":1.59579}1596gitlab # [ 181.824750] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"474c4046c827ebf4703045eb","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-474c4046c827ebf4703045eb: done: 0.011323 sec","job_status":"done","queue_duration_s":1.595774,"scheduling_latency_s":1.59579,"redis_calls":13,"redis_duration_s":0.001765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011323,"completed_at":"2026-10-26T21:34:07.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 181.877771] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06774823a0d8aa29f1c3229b","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06774823a0d8aa29f1c3229b: start","job_status":"start","queue_duration_s":1.6081,"scheduling_latency_s":1.608115}1598gitlab # [ 181.878972] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06774823a0d8aa29f1c3229b","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06774823a0d8aa29f1c3229b: done: 0.011974 sec","job_status":"done","queue_duration_s":1.6081,"scheduling_latency_s":1.608115,"redis_calls":13,"redis_duration_s":0.0018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001231,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011974,"completed_at":"2026-10-26T21:34:07.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 181.924659] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9322a25e62d262690ee1f228","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9322a25e62d262690ee1f228: start","job_status":"start","queue_duration_s":1.621122,"scheduling_latency_s":1.621137}1600gitlab # [ 181.925973] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9322a25e62d262690ee1f228","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9322a25e62d262690ee1f228: done: 0.011049 sec","job_status":"done","queue_duration_s":1.621122,"scheduling_latency_s":1.621137,"redis_calls":13,"redis_duration_s":0.001837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011049,"completed_at":"2026-10-26T21:34:07.250Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 181.973554] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e75e26067eef21b0138da98b","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e75e26067eef21b0138da98b: start","job_status":"start","queue_duration_s":1.633158,"scheduling_latency_s":1.633173}1602gitlab # [ 181.974534] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e75e26067eef21b0138da98b","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e75e26067eef21b0138da98b: done: 0.010904 sec","job_status":"done","queue_duration_s":1.633158,"scheduling_latency_s":1.633173,"redis_calls":13,"redis_duration_s":0.001816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001222,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010904,"completed_at":"2026-10-26T21:34:07.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 182.004957] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"496f1729be01ec0ecea6bf5e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-496f1729be01ec0ecea6bf5e: start","job_status":"start","queue_duration_s":1.645291,"scheduling_latency_s":1.645305}1604gitlab # [ 182.017682] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"496f1729be01ec0ecea6bf5e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-496f1729be01ec0ecea6bf5e: done: 0.011243 sec","job_status":"done","queue_duration_s":1.645291,"scheduling_latency_s":1.645305,"redis_calls":13,"redis_duration_s":0.0017889999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011243,"completed_at":"2026-10-26T21:34:07.275Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 182.073641] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"facf776f591ba8a288c95c2e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-facf776f591ba8a288c95c2e: start","job_status":"start","queue_duration_s":1.657514,"scheduling_latency_s":1.657528}1606gitlab # [ 182.074805] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"facf776f591ba8a288c95c2e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-facf776f591ba8a288c95c2e: done: 0.011217 sec","job_status":"done","queue_duration_s":1.657514,"scheduling_latency_s":1.657528,"redis_calls":13,"redis_duration_s":0.001853,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001287,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011217,"completed_at":"2026-10-26T21:34:07.287Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 182.106939] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37266c681d0d83a47fee4963","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37266c681d0d83a47fee4963: start","job_status":"start","queue_duration_s":1.66971,"scheduling_latency_s":1.669724}1608gitlab # [ 182.119308] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37266c681d0d83a47fee4963","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37266c681d0d83a47fee4963: done: 0.010601 sec","job_status":"done","queue_duration_s":1.66971,"scheduling_latency_s":1.669724,"redis_calls":13,"redis_duration_s":0.001693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010601,"completed_at":"2026-10-26T21:34:07.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 182.168529] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdc6b2040c459a9eb96211d2","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdc6b2040c459a9eb96211d2: start","job_status":"start","queue_duration_s":1.681271,"scheduling_latency_s":1.681286}1610gitlab # [ 182.169607] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdc6b2040c459a9eb96211d2","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdc6b2040c459a9eb96211d2: done: 0.010459 sec","job_status":"done","queue_duration_s":1.681271,"scheduling_latency_s":1.681286,"redis_calls":13,"redis_duration_s":0.001718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010459,"completed_at":"2026-10-26T21:34:07.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 182.212113] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93596f7ece8118e5fbbaf678","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93596f7ece8118e5fbbaf678: start","job_status":"start","queue_duration_s":1.692907,"scheduling_latency_s":1.692922}1612gitlab # [ 182.217172] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93596f7ece8118e5fbbaf678","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93596f7ece8118e5fbbaf678: done: 0.01224 sec","job_status":"done","queue_duration_s":1.692907,"scheduling_latency_s":1.692922,"redis_calls":13,"redis_duration_s":0.0018080000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01224,"completed_at":"2026-10-26T21:34:07.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 182.257370] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5223f8584cbf260e8f3da2be","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5223f8584cbf260e8f3da2be: start","job_status":"start","queue_duration_s":1.706148,"scheduling_latency_s":1.706162}1614gitlab # [ 182.308143] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5223f8584cbf260e8f3da2be","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5223f8584cbf260e8f3da2be: done: 0.010506 sec","job_status":"done","queue_duration_s":1.706148,"scheduling_latency_s":1.706162,"redis_calls":13,"redis_duration_s":0.001795,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001249,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010506,"completed_at":"2026-10-26T21:34:07.335Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 182.309785] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b296ecf6b3a505aa016f528","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b296ecf6b3a505aa016f528: start","job_status":"start","queue_duration_s":1.717586,"scheduling_latency_s":1.7176}1616gitlab # [ 182.317281] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b296ecf6b3a505aa016f528","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b296ecf6b3a505aa016f528: done: 0.011055 sec","job_status":"done","queue_duration_s":1.717586,"scheduling_latency_s":1.7176,"redis_calls":13,"redis_duration_s":0.00206,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001409,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011055,"completed_at":"2026-10-26T21:34:07.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 182.391972] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8903f6b1cd71a8f92f188ccf","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8903f6b1cd71a8f92f188ccf: start","job_status":"start","queue_duration_s":1.729705,"scheduling_latency_s":1.729719}1618gitlab # [ 182.393091] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8903f6b1cd71a8f92f188ccf","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8903f6b1cd71a8f92f188ccf: done: 0.010581 sec","job_status":"done","queue_duration_s":1.729705,"scheduling_latency_s":1.729719,"redis_calls":13,"redis_duration_s":0.001934,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001293,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010581,"completed_at":"2026-10-26T21:34:07.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 182.405833] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c96c83f524beb9bae1733dec","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c96c83f524beb9bae1733dec: start","job_status":"start","queue_duration_s":1.741255,"scheduling_latency_s":1.741269}1620gitlab # [ 182.418642] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c96c83f524beb9bae1733dec","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c96c83f524beb9bae1733dec: done: 0.010751 sec","job_status":"done","queue_duration_s":1.741255,"scheduling_latency_s":1.741269,"redis_calls":13,"redis_duration_s":0.002077,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001485,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010751,"completed_at":"2026-10-26T21:34:07.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 182.463933] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d457bf39e5327e82d07592f8","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d457bf39e5327e82d07592f8: start","job_status":"start","queue_duration_s":1.75317,"scheduling_latency_s":1.753183}1622gitlab # [ 182.468073] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d457bf39e5327e82d07592f8","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d457bf39e5327e82d07592f8: done: 0.016232 sec","job_status":"done","queue_duration_s":1.75317,"scheduling_latency_s":1.753183,"redis_calls":13,"redis_duration_s":0.007285,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016232,"completed_at":"2026-10-26T21:34:07.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 182.545441] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c325c0403b37c3b115537da5","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c325c0403b37c3b115537da5: start","job_status":"start","queue_duration_s":1.77042,"scheduling_latency_s":1.770435}1624gitlab # [ 182.546228] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c325c0403b37c3b115537da5","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c325c0403b37c3b115537da5: done: 0.010424 sec","job_status":"done","queue_duration_s":1.77042,"scheduling_latency_s":1.770435,"redis_calls":13,"redis_duration_s":0.001729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010424,"completed_at":"2026-10-26T21:34:07.399Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 182.556831] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f8c820ea32dfbd09d81377b","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f8c820ea32dfbd09d81377b: start","job_status":"start","queue_duration_s":1.782061,"scheduling_latency_s":1.782075}1626gitlab # [ 182.603115] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f8c820ea32dfbd09d81377b","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f8c820ea32dfbd09d81377b: done: 0.01039 sec","job_status":"done","queue_duration_s":1.782061,"scheduling_latency_s":1.782075,"redis_calls":13,"redis_duration_s":0.0016979999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001148,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01039,"completed_at":"2026-10-26T21:34:07.410Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 182.605619] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32384ae1b58db49a9a1f3512","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32384ae1b58db49a9a1f3512: start","job_status":"start","queue_duration_s":1.793389,"scheduling_latency_s":1.793404}1628gitlab # [ 182.618696] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32384ae1b58db49a9a1f3512","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32384ae1b58db49a9a1f3512: done: 0.010221 sec","job_status":"done","queue_duration_s":1.793389,"scheduling_latency_s":1.793404,"redis_calls":13,"redis_duration_s":0.001686,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010221,"completed_at":"2026-10-26T21:34:07.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 182.658635] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a312d9bc0cc2b1bf2274277","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a312d9bc0cc2b1bf2274277: start","job_status":"start","queue_duration_s":1.80454,"scheduling_latency_s":1.804554}1630gitlab # [ 182.701588] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a312d9bc0cc2b1bf2274277","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a312d9bc0cc2b1bf2274277: done: 0.010252 sec","job_status":"done","queue_duration_s":1.80454,"scheduling_latency_s":1.804554,"redis_calls":13,"redis_duration_s":0.0017000000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010252,"completed_at":"2026-10-26T21:34:07.433Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 182.706938] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7dd8a77149b4d3638bd47d0","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7dd8a77149b4d3638bd47d0: start","job_status":"start","queue_duration_s":1.815764,"scheduling_latency_s":1.815777}1632gitlab # [ 182.719923] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7dd8a77149b4d3638bd47d0","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7dd8a77149b4d3638bd47d0: done: 0.010524 sec","job_status":"done","queue_duration_s":1.815764,"scheduling_latency_s":1.815777,"redis_calls":13,"redis_duration_s":0.001787,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010524,"completed_at":"2026-10-26T21:34:07.444Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 182.788706] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4db55b2ec75272b3dbf825a6","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4db55b2ec75272b3dbf825a6: start","job_status":"start","queue_duration_s":1.827223,"scheduling_latency_s":1.827237}1634gitlab # [ 182.789739] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4db55b2ec75272b3dbf825a6","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4db55b2ec75272b3dbf825a6: done: 0.010418 sec","job_status":"done","queue_duration_s":1.827223,"scheduling_latency_s":1.827237,"redis_calls":13,"redis_duration_s":0.0017829999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001243,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010418,"completed_at":"2026-10-26T21:34:07.456Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 182.807686] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd68b9cbb41d91a8d598d52e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd68b9cbb41d91a8d598d52e: start","job_status":"start","queue_duration_s":1.838572,"scheduling_latency_s":1.838586}1636gitlab # [ 182.852616] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd68b9cbb41d91a8d598d52e","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd68b9cbb41d91a8d598d52e: done: 0.011458 sec","job_status":"done","queue_duration_s":1.838572,"scheduling_latency_s":1.838586,"redis_calls":13,"redis_duration_s":0.0017430000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011458,"completed_at":"2026-10-26T21:34:07.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 182.860809] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6116921486b82e6425cdab2","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6116921486b82e6425cdab2: start","job_status":"start","queue_duration_s":1.851006,"scheduling_latency_s":1.851021}1638gitlab # [ 182.874381] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6116921486b82e6425cdab2","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6116921486b82e6425cdab2: done: 0.010285 sec","job_status":"done","queue_duration_s":1.851006,"scheduling_latency_s":1.851021,"redis_calls":13,"redis_duration_s":0.0016779999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010285,"completed_at":"2026-10-26T21:34:07.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 182.930064] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62e907d48b55668791b78814","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62e907d48b55668791b78814: start","job_status":"start","queue_duration_s":1.862459,"scheduling_latency_s":1.862472}1640gitlab # [ 182.931037] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62e907d48b55668791b78814","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62e907d48b55668791b78814: done: 0.010406 sec","job_status":"done","queue_duration_s":1.862459,"scheduling_latency_s":1.862472,"redis_calls":13,"redis_duration_s":0.001797,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010406,"completed_at":"2026-10-26T21:34:07.491Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641gitlab # [ 182.982272] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7019de6c05e657d03abc048d","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7019de6c05e657d03abc048d: start","job_status":"start","queue_duration_s":1.874025,"scheduling_latency_s":1.874039}1642gitlab # [ 182.983348] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7019de6c05e657d03abc048d","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7019de6c05e657d03abc048d: done: 0.010254 sec","job_status":"done","queue_duration_s":1.874025,"scheduling_latency_s":1.874039,"redis_calls":13,"redis_duration_s":0.0016489999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010254,"completed_at":"2026-10-26T21:34:07.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 183.021444] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f240bb6408e83514695220a","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f240bb6408e83514695220a: start","job_status":"start","queue_duration_s":1.885204,"scheduling_latency_s":1.885218}1644gitlab # [ 183.065844] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f240bb6408e83514695220a","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f240bb6408e83514695220a: done: 0.010169 sec","job_status":"done","queue_duration_s":1.885204,"scheduling_latency_s":1.885218,"redis_calls":13,"redis_duration_s":0.0017000000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010169,"completed_at":"2026-10-26T21:34:07.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 183.072825] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae6a9086e156b63f3769b5a0","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae6a9086e156b63f3769b5a0: start","job_status":"start","queue_duration_s":1.896336,"scheduling_latency_s":1.896349}1646gitlab # [ 183.117918] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae6a9086e156b63f3769b5a0","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae6a9086e156b63f3769b5a0: done: 0.010689 sec","job_status":"done","queue_duration_s":1.896336,"scheduling_latency_s":1.896349,"redis_calls":13,"redis_duration_s":0.0017859999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010689,"completed_at":"2026-10-26T21:34:07.525Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 183.123870] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cc5c9f900b7aabdfb40a84d","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cc5c9f900b7aabdfb40a84d: start","job_status":"start","queue_duration_s":1.907968,"scheduling_latency_s":1.907982}1648gitlab # [ 183.136894] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:07.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cc5c9f900b7aabdfb40a84d","created_at":"2026-10-26T21:34:05.549Z","trace_propagation_headers":{"sentry-trace":"8a7af8fd856640b3b0f10c1498b551b0-35b15bbb9c484995","baggage":"sentry-trace_id=8a7af8fd856640b3b0f10c1498b551b0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8a90128d689b8b2d0b4be68c97083cf1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:05.618Z","job_size_bytes":2,"pid":1642,"sidekiq_tid":"maf2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cc5c9f900b7aabdfb40a84d: done: 0.010092 sec","job_status":"done","queue_duration_s":1.907968,"scheduling_latency_s":1.907982,"redis_calls":13,"redis_duration_s":0.0017590000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010092,"completed_at":"2026-10-26T21:34:07.536Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 199.597561] postgres[2527]: [2527] ERROR: relation "table_without_models" does not exist1650gitlab # [ 199.598790] postgres[2527]: [2527] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1651gitlab # [ 202.761679] runuser[2318]: pam_unix(runuser:session): session closed for user gitlab1652gitlab # [ 202.762607] setup-gitlab-start[2300]: + systemctl restart gitlab-sidekiq.service1653gitlab # [ 202.788421] systemd[1]: Stopping gitlab-sidekiq.service...1654gitlab # [ 202.795294] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:28.891Z","message":"Shutting down"}1655gitlab # [ 202.795895] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:28.891Z","message":"Scheduler exiting..."}1656gitlab # [ 202.796697] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:28.892Z","message":"Terminating quiet threads for default capsule"}1657gitlab # [ 202.797570] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:28.892Z","message":"Scheduler exiting..."}1658gitlab # [ 203.296953] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:29.393Z","message":"Pausing to allow jobs to finish..."}1659gitlab # [ 206.801489] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:32.897Z","message":"Bye!"}1660gitlab # [ 206.826939] sidekiq-cluster[1642]: {"severity":"INFO","time":"2026-10-26T21:34:32.923Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1642,"worker_id":"sidekiq_0","memwd_rss_bytes":963387392,"retry":0}1661gitlab # [ 207.415068] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1662gitlab # [ 207.417700] systemd[1]: Stopped gitlab-sidekiq.service.1663gitlab # [ 207.419703] systemd[1]: gitlab-sidekiq.service: Consumed 1min 6.436s CPU time over 2min 11.320s wall clock time, 975.3M memory peak, 5.5M read from disk.1664gitlab # [ 207.424570] systemd[1]: Started gitlab-sidekiq.service.1665gitlab # [ 207.427246] setup-gitlab-start[2300]: + mkdir -p /var/lib/secrets1666gitlab # [ 207.429478] setup-gitlab-start[2300]: + echo nixbot-test-token-of-20-chars1667gitlab # [ 207.431934] setup-gitlab-start[2300]: + chmod 644 /var/lib/secrets/gitlab-token1668gitlab # [ 207.434576] setup-gitlab-start[2300]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1669gitlab # [ 207.644842] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:33 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1881670gitlab # [ 208.145810] gitaly[901]: time="2026-10-26T21:34:34.242Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.242" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1671gitlab # [ 208.155660] gitaly[901]: time="2026-10-26T21:34:34.243Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.242" grpc.time_ms=0.436 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672gitlab # [ 208.278626] gitaly[901]: time="2026-10-26T21:34:34.375Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.134" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.375" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673gitlab # [ 208.302789] gitaly[901]: time="2026-10-26T21:34:34.375Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.134" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.375" grpc.time_ms=0.339 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1674gitlab # [ 208.325319] gitaly[901]: time="2026-10-26T21:34:34.422Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 diskcache=57c88499-ec50-4e5f-bd18-3053aac7037b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T21:34:44.142" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.383" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675gitlab # [ 208.325702] gitaly[901]: time="2026-10-26T21:34:34.422Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1577 command.oublock=32 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T21:34:44.142" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.383" grpc.time_ms=39.456 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 208.339172] gitaly[901]: time="2026-10-26T21:34:34.436Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.195" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.435" pid=901 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1677gitlab # [ 208.340254] gitaly[901]: time="2026-10-26T21:34:34.436Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.195" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.435" grpc.time_ms=0.401 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1678gitlab # [ 208.396500] gitaly[901]: time="2026-10-26T21:34:34.493Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T21:34:44.242" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.482" grpc.time_ms=10.164 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679gitlab # [ 208.474093] gitaly[901]: time="2026-10-26T21:34:34.570Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.570" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680gitlab # [ 208.474917] gitaly[901]: time="2026-10-26T21:34:34.571Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.570" grpc.time_ms=0.289 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab # [ 208.547322] gitaly[901]: time="2026-10-26T21:34:34.644Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 diskcache=978ad0eb-4150-44c5-b57e-ba04ffeff6ba grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T21:34:44.038" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.598" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1682gitlab # [ 208.560225] gitaly[901]: time="2026-10-26T21:34:34.644Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1582 command.oublock=32 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T21:34:44.038" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.598" grpc.time_ms=45.842 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1683gitlab # [ 208.583242] gitaly[901]: time="2026-10-26T21:34:34.680Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.119" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.679" pid=901 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1684gitlab # [ 208.596268] gitaly[901]: time="2026-10-26T21:34:34.680Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.119" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.679" grpc.time_ms=0.838 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685gitlab # [ 208.616431] gitaly[901]: time="2026-10-26T21:34:34.713Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T21:34:44.147" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.707" grpc.time_ms=5.857 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1686gitlab # [ 208.651910] gitaly[901]: time="2026-10-26T21:34:34.748Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:34:44.188" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.748" grpc.time_ms=0.142 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1687gitlab # [ 208.671930] gitaly[901]: time="2026-10-26T21:34:34.769Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T21:34:44.208" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:34.768" grpc.time_ms=0.194 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1688gitlab # [ 209.119385] gitaly[901]: time="2026-10-26T21:34:35.216Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X25X8Q6683VGDNW0AY99E6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T21:34:45.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:35.210" grpc.time_ms=5.424 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1689gitlab # [ 209.421975] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:35 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 17661690gitlab # [ 209.426394] setup-gitlab-start[2581]: {"id":1,"message":null,"error":null}1691gitlab # [ 210.929129] sidekiq-cluster[2569]: {"severity":"INFO","time":"2026-10-26T21:34:37.005Z","message":"Starting cluster with 1 processes"}1692gitlab # [ 214.562600] gitaly[901]: time="2026-10-26T21:34:40.658Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X263WVF0KS862SB36WRDF0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T21:34:50.087" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:40.648" grpc.time_ms=10.591 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1693gitlab # [ 214.618438] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:40 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1741694gitlab # [ 214.621101] setup-gitlab-start[2300]: + mkdir -p /tmp/test-flake1695gitlab # [ 214.622666] setup-gitlab-start[2300]: + cd /tmp/test-flake1696gitlab # [ 214.623590] setup-gitlab-start[2300]: + git init -b master1697gitlab # [ 214.645281] setup-gitlab-start[2655]: Initialized empty Git repository in /tmp/test-flake/.git/1698gitlab # [ 214.645848] setup-gitlab-start[2300]: + git config user.name test1699gitlab # [ 214.647954] setup-gitlab-start[2300]: + git config user.email test@example.com1700gitlab # [ 214.650131] setup-gitlab-start[2300]: + cat1701gitlab # [ 214.653934] setup-gitlab-start[2300]: + git add flake.nix1702gitlab # [ 214.659638] setup-gitlab-start[2300]: + git commit -m 'initial commit'1703gitlab # [ 214.679594] setup-gitlab-start[2660]: [master (root-commit) 9d78aeb] initial commit1704gitlab # [ 214.679997] setup-gitlab-start[2660]: 1 file changed, 10 insertions(+)1705gitlab # [ 214.680533] setup-gitlab-start[2660]: create mode 100644 flake.nix1706gitlab # [ 214.681118] setup-gitlab-start[2300]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1707gitlab # [ 214.687870] setup-gitlab-start[2300]: + git push -u origin master1708gitlab # [ 214.734419] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 251709gitlab # [ 214.830652] gitaly[901]: time="2026-10-26T21:34:40.927Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X26461H0FW6WZAWFRP262T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:40.917" grpc.time_ms=10.156 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1710gitlab # [ 214.832319] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 951711gitlab # [ 215.345467] gitaly[901]: time="2026-10-26T21:34:41.442Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T21:34:51.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:41.435" grpc.time_ms=6.104 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1712gitlab # [ 215.399470] gitaly[901]: time="2026-10-26T21:34:41.496Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-26T21:35:11.086" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-26T21:34:41.487" grpc.time_ms=8.508 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713gitlab # [ 215.490490] gitaly[901]: time="2026-10-26T21:34:41.587Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5X2649C48N187T56AMEGWW1 duration_ms=526ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/allowed"1714gitlab # [ 215.530883] gitaly[901]: time="2026-10-26T21:34:41.627Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5X2649C48N187T56AMEGWW1 duration_ms=39ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/pre_receive"1715gitlab # [ 215.531441] gitaly[901]: time="2026-10-26T21:34:41.628Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5308 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:34:41.059" grpc.time_ms=569.085 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1716gitlab # [ 215.602101] gitaly[901]: time="2026-10-26T21:34:41.698Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:34:41.696" grpc.time_ms=1.778 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1717gitlab # [ 215.671827] gitaly[901]: time="2026-10-26T21:34:41.768Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4777 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:34:41.768" grpc.time_ms=0.626 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1718gitlab # [ 215.738141] gitaly[901]: time="2026-10-26T21:34:41.834Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:34:41.834" grpc.time_ms=0.582 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719gitlab # [ 215.902479] gitaly[901]: time="2026-10-26T21:34:41.999Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T21:34:51.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:41.988" grpc.time_ms=11.177 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1720gitlab # [ 215.930500] gitaly[901]: time="2026-10-26T21:34:42.027Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1569 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-26T21:34:52.008" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:34:42.008" grpc.time_ms=18.416 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1721gitlab # [ 215.973053] gitaly[901]: time="2026-10-26T21:34:42.070Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5X2649C48N187T56AMEGWW1 duration_ms=174ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/post_receive"1722gitlab # [ 215.973915] gitaly[901]: time="2026-10-26T21:34:42.070Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4802 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:34:41.895" grpc.time_ms=175.499 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1723gitlab # [ 216.010293] gitaly[901]: time="2026-10-26T21:34:42.107Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 diskcache=3091075f-5634-49b3-aaff-fc0ead1cb86c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:40.996" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1724gitlab # [ 216.010685] gitaly[901]: time="2026-10-26T21:34:42.107Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=245 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13795 command.oublock=32 command.real_time_ms=1101 command.spawn_token_fork_ms=1 command.system_time_ms=155 command.user_time_ms=90 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:40.996" grpc.time_ms=1111.114 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1725gitlab # [ 216.012267] gitlab-workhorse[826]: time="2026-10-26T21:34:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521726gitlab # [ 216.013389] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:42 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 11681727gitlab # [ 216.014725] setup-gitlab-start[2664]: To http://gitlab/root/test-flake.git1728gitlab # [ 216.016044] setup-gitlab-start[2664]: * [new branch] master -> master1729gitlab # [ 216.042628] setup-gitlab-start[2664]: branch 'master' set up to track 'origin/master'.1730gitlab # [ 216.046254] systemd[1]: Finished setup-gitlab.service.1731gitlab # [ 216.048557] systemd[1]: Starting nixbot CI service...1732gitlab: (finished: waiting for unit setup-gitlab.service, in 216.87 seconds)1733gitlab: waiting for unit nixbot.service1734gitlab # [ 217.327084] nixbot[2751]: {"ts": "2026-10-26T21:34:43.423Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1735gitlab # [ 217.351865] nixbot[2751]: {"ts": "2026-10-26T21:34:43.448Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1736gitlab # [ 217.365126] nixbot[2751]: {"ts": "2026-10-26T21:34:43.462Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1737gitlab # [ 217.369863] nixbot[2751]: {"ts": "2026-10-26T21:34:43.466Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1738gitlab # [ 217.374834] nixbot[2751]: {"ts": "2026-10-26T21:34:43.471Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1739gitlab # [ 217.379278] nixbot[2751]: {"ts": "2026-10-26T21:34:43.476Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1740gitlab # [ 217.382808] nixbot[2751]: {"ts": "2026-10-26T21:34:43.479Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1741gitlab # [ 217.386375] nixbot[2751]: {"ts": "2026-10-26T21:34:43.483Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1742gitlab # [ 217.390238] nixbot[2751]: {"ts": "2026-10-26T21:34:43.487Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1743gitlab # [ 217.394281] nixbot[2751]: {"ts": "2026-10-26T21:34:43.491Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1744gitlab # [ 217.398507] nixbot[2751]: {"ts": "2026-10-26T21:34:43.495Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1745gitlab # [ 217.403545] nixbot[2751]: {"ts": "2026-10-26T21:34:43.500Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1746gitlab # [ 217.406425] nixbot[2751]: {"ts": "2026-10-26T21:34:43.503Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1747gitlab # [ 217.408913] nixbot[2751]: {"ts": "2026-10-26T21:34:43.505Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1748gitlab # [ 217.412724] nixbot[2751]: {"ts": "2026-10-26T21:34:43.509Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1749gitlab # [ 217.415273] nixbot[2751]: {"ts": "2026-10-26T21:34:43.512Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1750gitlab # [ 217.419243] nixbot[2751]: {"ts": "2026-10-26T21:34:43.516Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1751gitlab # [ 217.423389] nixbot[2751]: {"ts": "2026-10-26T21:34:43.520Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1752gitlab # [ 217.429384] nixbot[2751]: {"ts": "2026-10-26T21:34:43.526Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1753gitlab # [ 217.433106] nixbot[2751]: {"ts": "2026-10-26T21:34:43.530Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1754gitlab # [ 217.436688] nixbot[2751]: {"ts": "2026-10-26T21:34:43.533Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1755gitlab # [ 217.443824] nixbot[2751]: {"ts": "2026-10-26T21:34:43.540Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1756gitlab # [ 217.447576] nixbot[2751]: {"ts": "2026-10-26T21:34:43.544Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1757gitlab # [ 217.451607] nixbot[2751]: {"ts": "2026-10-26T21:34:43.548Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1758gitlab # [ 217.455481] nixbot[2751]: {"ts": "2026-10-26T21:34:43.552Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1759gitlab # [ 217.459657] nixbot[2751]: {"ts": "2026-10-26T21:34:43.556Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1760gitlab # [ 217.463487] nixbot[2751]: {"ts": "2026-10-26T21:34:43.560Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1761gitlab # [ 217.467213] nixbot[2751]: {"ts": "2026-10-26T21:34:43.564Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1762gitlab # [ 217.471825] nixbot[2751]: {"ts": "2026-10-26T21:34:43.568Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1763gitlab # [ 217.491403] nixbot[2751]: {"ts": "2026-10-26T21:34:43.588Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1764gitlab # [ 217.497358] nixbot[2751]: {"ts": "2026-10-26T21:34:43.594Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1765gitlab # [ 217.501424] nixbot[2751]: {"ts": "2026-10-26T21:34:43.598Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1766gitlab # [ 217.505420] nixbot[2751]: {"ts": "2026-10-26T21:34:43.602Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1767gitlab # [ 217.511405] nixbot[2751]: {"ts": "2026-10-26T21:34:43.608Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1768gitlab # [ 217.515592] nixbot[2751]: {"ts": "2026-10-26T21:34:43.612Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1769gitlab # [ 217.525816] nixbot[2751]: {"ts": "2026-10-26T21:34:43.622Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1770gitlab # [ 217.529972] nixbot[2751]: {"ts": "2026-10-26T21:34:43.626Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1771gitlab # [ 217.535870] nixbot[2751]: {"ts": "2026-10-26T21:34:43.632Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"}1772gitlab # [ 217.540096] nixbot[2751]: {"ts": "2026-10-26T21:34:43.637Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 38, "migration": "commit_statuses"}1773gitlab # [ 217.942449] nixbot[2751]: {"ts": "2026-10-26T21:34:44.039Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2751]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"}1774gitlab # [ 217.943468] nixbot[2751]: {"ts": "2026-10-26T21:34:44.039Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"}1775gitlab # [ 217.964155] nixbot[2751]: {"ts": "2026-10-26T21:34:44.060Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:45656 - \"GET /health HTTP/1.1\" 200"}1776gitlab # [ 217.974312] systemd[1]: Started nixbot CI service.1777gitlab # [ 217.974528] systemd[1]: Reached target Multi-User System.1778gitlab # [ 217.979285] systemd[1]: Startup finished in 1.251s (kernel) + 3.653s (initrd) + 3min 33.073s (userspace) = 3min 37.979s.1779gitlab # [ 218.189388] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:44 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2251780gitlab # [ 218.213590] nixbot[2751]: {"ts": "2026-10-26T21:34:44.310Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1781gitlab: (finished: waiting for unit nixbot.service, in 2.07 seconds)1782gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1783gitlab # [ 218.318627] nixbot[2751]: {"ts": "2026-10-26T21:34:44.414Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:45658 - \"GET /health HTTP/1.1\" 200"}1784gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1785subtest: project discovered and webhook registered1786gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1787gitlab # [ 218.332210] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1011788gitlab # [ 218.334719] nixbot[2751]: {"ts": "2026-10-26T21:34:44.430Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1789gitlab # [ 218.452603] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 991790gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.13 seconds)1791gitlab # [ 218.530496] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 1881792gitlab # [ 219.277166] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:45 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 7381793gitlab # [ 219.354493] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 671794gitlab # [ 219.411899] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:45 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 531795gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1796gitlab # [ 219.479479] gitaly[901]: time="2026-10-26T21:34:45.575Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X268RB2Q0KJ723FK7YB8MG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-26T21:35:15.059" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:34:45.560" grpc.time_ms=14.866 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 219.530200] gitaly[901]: time="2026-10-26T21:34:45.626Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X268RB2Q0KJ723FK7YB8MG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:35:15.124" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:34:45.625" grpc.time_ms=0.98 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 219.573109] gitaly[901]: time="2026-10-26T21:34:45.669Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X268RB2Q0KJ723FK7YB8MG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-26T21:34:55.096" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:34:45.657" grpc.time_ms=12.382 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 219.576814] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 571800gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.14 seconds)1801(finished: subtest: project discovered and webhook registered, in 1.27 seconds)1802subtest: push delivers the webhook1803gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1804gitlab # [ 219.614278] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1951805gitlab # [ 219.684313] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 631806gitlab # [ 219.696401] nixbot[2751]: {"ts": "2026-10-26T21:34:45.792Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1807gitlab # [ 219.849131] gitaly[901]: time="2026-10-26T21:34:45.945Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X2693D67QCJ62BD6FNSCR7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:45.933" grpc.time_ms=11.932 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1808gitlab # [ 219.879842] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 771809gitlab # [ 219.970077] gitaly[901]: time="2026-10-26T21:34:46.066Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X2695WTBF9ASJCS8GMQMA2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.052" pid=901 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1810gitlab # [ 219.971123] gitaly[901]: time="2026-10-26T21:34:46.067Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2695WTBF9ASJCS8GMQMA2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.052" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1811gitlab # [ 220.022633] gitaly[901]: time="2026-10-26T21:34:46.119Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2695WTBF9ASJCS8GMQMA2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.052" grpc.time_ms=66.419 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1812gitlab # [ 220.045398] gitlab-workhorse[826]: time="2026-10-26T21:34:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131813gitlab # [ 220.045758] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1931814gitlab # [ 220.117952] gitaly[901]: time="2026-10-26T21:34:46.214Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X269C6T9155R2ZWV0F8N9J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.197" pid=901 remote_ip="2001:db8:1::1" request_sha=3aa6cf01b024961e850465dac3ba3a7ad335e63f response_bytes=223 span.kind=server system=grpc1815gitlab # [ 220.141065] gitaly[901]: time="2026-10-26T21:34:46.215Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X269C6T9155R2ZWV0F8N9J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.197" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1816gitlab # [ 220.166245] gitaly[901]: time="2026-10-26T21:34:46.238Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X269C6T9155R2ZWV0F8N9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.197" grpc.time_ms=40.353 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1817gitlab # [ 220.179826] gitlab-workhorse[826]: time="2026-10-26T21:34:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231818gitlab # [ 220.181696] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 881819gitlab # [ 220.286373] gitaly[901]: time="2026-10-26T21:34:46.383Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5X269HBY73WNQAJTGB8JDCE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.369" grpc.time_ms=13.679 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1820gitlab # [ 220.317457] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 981821gitlab # [ 220.403951] gitaly[901]: time="2026-10-26T21:34:46.500Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X269MK602KWBZRFR9QGXA5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.488" pid=901 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1822gitlab # [ 220.404257] gitaly[901]: time="2026-10-26T21:34:46.501Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X269MK602KWBZRFR9QGXA5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.488" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1823gitlab # [ 220.405065] gitaly[901]: time="2026-10-26T21:34:46.501Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X269MK602KWBZRFR9QGXA5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.488" grpc.time_ms=12.865 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1824gitlab # [ 220.473426] gitlab-workhorse[826]: time="2026-10-26T21:34:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671825gitlab # [ 220.474052] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1511826gitlab # [ 220.579495] gitaly[901]: time="2026-10-26T21:34:46.675Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X269T9DSN189SG13TXWYKR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.662" grpc.time_ms=12.62 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1827gitlab # [ 220.609849] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1041828gitlab # [ 220.689245] gitaly[901]: time="2026-10-26T21:34:46.785Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X269XT41D1ZDQ6S102759D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.769" pid=901 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1829gitlab # [ 220.689704] gitaly[901]: time="2026-10-26T21:34:46.785Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X269XT41D1ZDQ6S102759D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.769" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1830gitlab # [ 220.690943] gitaly[901]: time="2026-10-26T21:34:46.786Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X269XT41D1ZDQ6S102759D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:34:46.769" grpc.time_ms=16.61 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1831gitlab # [ 220.739183] gitlab-workhorse[826]: time="2026-10-26T21:34:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091832gitlab # [ 220.739490] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 721833gitlab # [ 220.814638] gitaly[901]: time="2026-10-26T21:34:46.911Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:35:16.510" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:34:46.911" grpc.time_ms=0.5 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1834gitlab # [ 220.883061] gitaly[901]: time="2026-10-26T21:34:46.980Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-26T21:35:16.569" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:34:46.969" grpc.time_ms=9.9 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1835gitlab # [ 220.934617] gitaly[901]: time="2026-10-26T21:34:47.031Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:34:57.022" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:34:47.022" grpc.time_ms=8.66 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 220.946948] gitaly[901]: time="2026-10-26T21:34:47.043Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:34:57.037" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:34:47.037" grpc.time_ms=5.908 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 221.077545] gitaly[901]: time="2026-10-26T21:34:47.174Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T21:34:57.172" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:47.173" grpc.time_ms=0.449 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1838gitlab # [ 221.124458] gitaly[901]: time="2026-10-26T21:34:47.221Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T21:34:57.208" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:34:47.208" grpc.time_ms=12.308 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1839gitlab # [ 221.209669] gitaly[901]: time="2026-10-26T21:34:47.306Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4147 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:34:47.305" grpc.time_ms=0.599 pid=901 span.kind=server system=grpc1840gitlab # [ 221.269322] gitaly[901]: time="2026-10-26T21:34:47.366Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:34:47.365" grpc.time_ms=0.538 pid=901 span.kind=server system=grpc1841gitlab # [ 221.297318] gitaly[901]: time="2026-10-26T21:34:47.394Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF diskcache=0469de3c-999c-4178-9054-91b7f5b973d6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T21:34:57.253" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:47.253" pid=901 ref=refs/keep-around/9d78aeb7030807f8f740532b56c9ed68046a5bf3 remote_ip="2001:db8:1::1" revision=9d78aeb7030807f8f740532b56c9ed68046a5bf3 span.kind=server system=grpc username=root1842gitlab # [ 221.308532] gitaly[901]: time="2026-10-26T21:34:47.394Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=104 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5602 command.oublock=8 command.real_time_ms=130 command.spawn_token_fork_ms=0 command.system_time_ms=63 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T21:34:57.253" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:34:47.253" grpc.time_ms=140.64 pid=901 ref=refs/keep-around/9d78aeb7030807f8f740532b56c9ed68046a5bf3 remote_ip="2001:db8:1::1" revision=9d78aeb7030807f8f740532b56c9ed68046a5bf3 span.kind=server system=grpc username=root1843gitlab # [ 221.323720] gitaly[901]: time="2026-10-26T21:34:47.420Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:35:17.119" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:34:47.420" grpc.time_ms=0.529 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1844gitlab # [ 221.504108] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9d78aeb7030807f8f740532b56c9ed68046a5bf3 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 7331845gitlab # [ 221.518354] nixbot[2751]: {"ts": "2026-10-26T21:34:47.614Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-9d78aeb70308-0"}1846gitlab # [ 221.713929] nixbot[2751]: {"ts": "2026-10-26T21:34:47.810Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-9d78aeb70308-0", "argv0": "bwrap"}1847gitlab # [ 221.831758] systemd[1]: Started Nix Daemon.1848gitlab # [ 221.903972] nix-daemon[2918]: accepted connection from pid 2913, user nixbot1849gitlab # [ 225.976165] nix-daemon[2918]: accepted connection from pid 2961, user nixbot1850gitlab # [ 225.993893] nix-daemon[2918]: accepted connection from pid 2913, user nixbot1851gitlab # [ 230.111320] nix-daemon[2918]: accepted connection from pid 2913, user nixbot1852gitlab # [ 230.215479] nix-daemon[2918]: accepted connection from pid 3007, user nixbot1853gitlab # [ 230.244356] gitaly[901]: time="2026-10-26T21:34:56.340Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26K95C5QWH65AS6SB1ZVA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:35:26.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:34:56.339" grpc.time_ms=0.815 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 230.292284] gitaly[901]: time="2026-10-26T21:34:56.389Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5X26K95C5QWH65AS6SB1ZVA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:06.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:34:56.378" grpc.time_ms=10.453 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1855gitlab # [ 230.330383] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9d78aeb7030807f8f740532b56c9ed68046a5bf3 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1321856gitlab # [ 230.415058] gitaly[901]: time="2026-10-26T21:34:56.511Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26KDRPY2PH558SB7BQBP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:35:26.009" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:34:56.510" grpc.time_ms=0.731 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857gitlab # [ 230.514236] gitaly[901]: time="2026-10-26T21:34:56.611Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X26KDRPY2PH558SB7BQBP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:06.044" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:34:56.604" grpc.time_ms=6.263 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858gitlab # [ 230.588795] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:34:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9d78aeb7030807f8f740532b56c9ed68046a5bf3 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2441859gitlab # [ 235.042462] nix-daemon[2918]: accepted connection from pid 3062, user nixbot1860gitlab # [ 235.121440] gitaly[901]: time="2026-10-26T21:35:01.217Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26R1KPRK49N5TSP80XZ8N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:35:31.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:01.211" grpc.time_ms=6.467 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1861gitlab # [ 235.165321] gitaly[901]: time="2026-10-26T21:35:01.262Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X26R1KPRK49N5TSP80XZ8N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:11.255" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:01.255" grpc.time_ms=6.263 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862gitlab # [ 235.242572] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9d78aeb7030807f8f740532b56c9ed68046a5bf3 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1671863gitlab # [ 235.488717] nixbot[2751]: {"ts": "2026-10-26T21:35:01.584Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "9d78aeb7030807f8f740532b56c9ed68046a5bf3", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}1864gitlab # [ 235.562853] gitaly[901]: time="2026-10-26T21:35:01.659Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X26RFFCJ743V7642WQJEF8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:01.652" grpc.time_ms=6.767 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1865gitlab # [ 235.566528] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 471866gitlab # [ 235.645814] gitaly[901]: time="2026-10-26T21:35:01.742Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X26RH0GGVQ2B683DE4J6R0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:01.730" pid=901 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1867gitlab # [ 235.655538] gitaly[901]: time="2026-10-26T21:35:01.742Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26RH0GGVQ2B683DE4J6R0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:01.730" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1868gitlab # [ 235.667921] gitlab-workhorse[826]: time="2026-10-26T21:35:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671869gitlab # [ 235.670092] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 801870gitlab # [ 235.672037] gitaly[901]: time="2026-10-26T21:35:01.743Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26RH0GGVQ2B683DE4J6R0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:01.730" grpc.time_ms=13.185 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1871gitlab # [ 235.735430] gitaly[901]: time="2026-10-26T21:35:01.832Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X26RMQRB1AD75BW2WR97Q5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:01.825" grpc.time_ms=6.459 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1872gitlab # [ 235.736296] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 481873gitlab # [ 235.786641] gitaly[901]: time="2026-10-26T21:35:01.883Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X26RP9E0DNW04Z0ZE670BB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:01.875" pid=901 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1874gitlab # [ 235.796633] gitaly[901]: time="2026-10-26T21:35:01.883Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26RP9E0DNW04Z0ZE670BB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:01.875" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1875gitlab # [ 235.809226] gitlab-workhorse[826]: time="2026-10-26T21:35:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671876gitlab # [ 235.809508] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 501877gitlab # [ 235.810059] gitaly[901]: time="2026-10-26T21:35:01.883Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26RP9E0DNW04Z0ZE670BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:01.875" grpc.time_ms=7.996 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1878gitlab # [ 244.097843] sidekiq-cluster[2628]: 2026-10-26T21:35:10.193Z pid=2628 tid=xd8 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2628, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430747648}1879gitlab # [ 244.287721] sidekiq-cluster[2628]: W, [2026-10-26T21:35:10.384545 #2628] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1880gitlab # [ 244.328733] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:10.425Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1881gitlab # [ 246.212350] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:12.308Z","message":"GitLab reliable fetch activated!"}1882gitlab # [ 246.212687] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:12.308Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1883gitlab # [ 267.677712] postgres[3377]: [3377] ERROR: relation "table_without_models" does not exist1884gitlab # [ 267.678222] postgres[3377]: [3377] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1885gitlab # [ 270.359840] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:36.456Z","message":"Booted Rails 7.2.3.1 application in production environment"}1886gitlab # [ 270.362404] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:36.458Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1887gitlab # [ 270.364348] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:36.458Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1888gitlab # [ 270.366085] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:36.458Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1889gitlab # [ 270.368052] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:36.463Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1890gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 50.83 seconds)1891gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1892gitlab # [ 270.508339] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:36 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 481893gitlab # [ 270.604493] gitaly[901]: time="2026-10-26T21:35:36.700Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TMYCCVD185EA80SYG9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:36.687" grpc.time_ms=13.332 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1894gitlab # [ 270.634651] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:36 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 941895gitlab # Enumerating objects: 5, done.1896gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1897gitlab # Delta compression using up to 4 threads1898gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1899gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 137.00 KiB/s, done.1900gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1901gitlab # [ 270.845375] gitaly[901]: time="2026-10-26T21:35:36.942Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-26T21:36:06.434" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-26T21:35:36.934" grpc.time_ms=7.576 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1902gitlab # [ 270.891921] gitaly[901]: time="2026-10-26T21:35:36.988Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5X27TSKGBADKENBXQ4G18V1 duration_ms=104ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/allowed"1903gitlab # [ 270.910125] gitaly[901]: time="2026-10-26T21:35:37.007Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5X27TSKGBADKENBXQ4G18V1 duration_ms=17ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/pre_receive"1904gitlab # [ 270.910386] gitaly[901]: time="2026-10-26T21:35:37.007Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5308 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:36.883" grpc.time_ms=123.716 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1905gitlab # [ 270.961145] gitaly[901]: time="2026-10-26T21:35:37.058Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:37.057" grpc.time_ms=0.424 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1906gitlab # [ 271.001444] gitaly[901]: time="2026-10-26T21:35:37.098Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4777 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:37.098" grpc.time_ms=0.384 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1907gitlab # [ 271.030483] gitaly[901]: time="2026-10-26T21:35:37.127Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:37.127" grpc.time_ms=0.285 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1908gitlab # [ 271.092857] gitaly[901]: time="2026-10-26T21:35:37.189Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5X27TSKGBADKENBXQ4G18V1 duration_ms=33ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/post_receive"1909gitlab # [ 271.097727] gitaly[901]: time="2026-10-26T21:35:37.190Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4802 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:37.155" grpc.time_ms=34.248 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1910gitlab # [ 271.119897] gitaly[901]: time="2026-10-26T21:35:37.216Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 diskcache=88b00ffe-1674-4653-a538-a379b540e38d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:36.829" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1911gitlab # [ 271.120327] gitaly[901]: time="2026-10-26T21:35:37.217Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=161 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13857 command.oublock=32 command.real_time_ms=379 command.spawn_token_fork_ms=0 command.system_time_ms=101 command.user_time_ms=60 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:36.829" grpc.time_ms=387.772 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1912gitlab # [ 271.120922] gitlab-workhorse[826]: time="2026-10-26T21:35:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521913gitlab # [ 271.121423] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:37 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4611914gitlab # To http://gitlab/root/test-flake.git1915gitlab # 9d78aeb..4dc27d6 master -> master1916gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.73 seconds)1917gitlab: must succeed: git -C /tmp/test-flake rev-parse master1918gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1919gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e'1920gitlab # [ 271.223187] nixbot[2751]: {"ts": "2026-10-26T21:35:37.319Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:56398 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1\" 200"}1921gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e', in 0.07 seconds)1922gitlab # [ 271.839821] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:37.935Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a13744c650a9cbf2138e1d8e","created_at":"2026-10-26T21:34:34.520Z","trace_propagation_headers":{"sentry-trace":"1fdb22bad04145b48bd1c668d38fea28-3b651932e5b14040","baggage":"sentry-trace_id=1fdb22bad04145b48bd1c668d38fea28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X25X8Q6683VGDNW0AY99E6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:34.552Z","job_size_bytes":2,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a13744c650a9cbf2138e1d8e: start","job_status":"start","queue_duration_s":63.383436,"scheduling_latency_s":63.383483}1923gitlab # [ 271.977356] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.073Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a13744c650a9cbf2138e1d8e","created_at":"2026-10-26T21:34:34.520Z","trace_propagation_headers":{"sentry-trace":"1fdb22bad04145b48bd1c668d38fea28-3b651932e5b14040","baggage":"sentry-trace_id=1fdb22bad04145b48bd1c668d38fea28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X25X8Q6683VGDNW0AY99E6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:34.552Z","job_size_bytes":2,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a13744c650a9cbf2138e1d8e: done: 0.138304 sec","job_status":"done","queue_duration_s":63.383436,"scheduling_latency_s":63.383483,"redis_calls":23,"redis_duration_s":0.005812,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.003053,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00143,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001329,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07823201,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.138304,"completed_at":"2026-10-26T21:35:38.073Z","load_balancing_strategy":"primary","db_duration_s":0.047503,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1924gitlab # [ 271.978357] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.075Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e6f6b2ab650adafd68d38ff4","created_at":"2026-10-26T21:34:34.562Z","trace_propagation_headers":{"sentry-trace":"1fdb22bad04145b48bd1c668d38fea28-3b651932e5b14040","baggage":"sentry-trace_id=1fdb22bad04145b48bd1c668d38fea28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X25X8Q6683VGDNW0AY99E6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:34.566Z","job_size_bytes":2,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e6f6b2ab650adafd68d38ff4: start","job_status":"start","queue_duration_s":63.508406,"scheduling_latency_s":63.508426}1925gitlab # [ 272.051160] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.147Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e6f6b2ab650adafd68d38ff4","created_at":"2026-10-26T21:34:34.562Z","trace_propagation_headers":{"sentry-trace":"1fdb22bad04145b48bd1c668d38fea28-3b651932e5b14040","baggage":"sentry-trace_id=1fdb22bad04145b48bd1c668d38fea28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X25X8Q6683VGDNW0AY99E6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:34.566Z","job_size_bytes":2,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e6f6b2ab650adafd68d38ff4: done: 0.072514 sec","job_status":"done","queue_duration_s":63.508406,"scheduling_latency_s":63.508426,"redis_calls":14,"redis_duration_s":0.0021709999999999998,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000416,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.056513886,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.072514,"completed_at":"2026-10-26T21:35:38.147Z","load_balancing_strategy":"primary","db_duration_s":0.015158,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1926gitlab # [ 272.078482] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.148Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"8097496809c9e5062ff3928b","created_at":"2026-10-26T21:34:35.140Z","trace_propagation_headers":{"sentry-trace":"1fdb22bad04145b48bd1c668d38fea28-3b651932e5b14040","baggage":"sentry-trace_id=1fdb22bad04145b48bd1c668d38fea28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X25X8Q6683VGDNW0AY99E6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:35.144Z","job_size_bytes":5,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-8097496809c9e5062ff3928b: start","job_status":"start","queue_duration_s":63.00393,"scheduling_latency_s":63.003947}1927gitlab # [ 272.163163] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.259Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"8097496809c9e5062ff3928b","created_at":"2026-10-26T21:34:35.140Z","trace_propagation_headers":{"sentry-trace":"1fdb22bad04145b48bd1c668d38fea28-3b651932e5b14040","baggage":"sentry-trace_id=1fdb22bad04145b48bd1c668d38fea28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X25X8Q6683VGDNW0AY99E6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:35.144Z","job_size_bytes":5,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-8097496809c9e5062ff3928b: done: 0.110746 sec","job_status":"done","queue_duration_s":63.00393,"scheduling_latency_s":63.003947,"redis_calls":12,"redis_duration_s":0.0018239999999999999,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000434,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000288584,"duration_s":0.110746,"completed_at":"2026-10-26T21:35:38.259Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013357,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1928gitlab # [ 272.164890] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.260Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"a3f18835f5fcb19b676e6477","created_at":"2026-10-26T21:34:35.162Z","trace_propagation_headers":{"sentry-trace":"1fdb22bad04145b48bd1c668d38fea28-3b651932e5b14040","baggage":"sentry-trace_id=1fdb22bad04145b48bd1c668d38fea28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X25X8Q6683VGDNW0AY99E6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:35.165Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-a3f18835f5fcb19b676e6477: start","job_status":"start","queue_duration_s":63.095476,"scheduling_latency_s":63.095495}1929gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e'1930gitlab # [ 272.265513] nixbot[2751]: {"ts": "2026-10-26T21:35:38.361Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:56404 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1\" 200"}1931gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e', in 0.04 seconds)1932gitlab # [ 272.304381] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.401Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"a3f18835f5fcb19b676e6477","created_at":"2026-10-26T21:34:35.162Z","trace_propagation_headers":{"sentry-trace":"1fdb22bad04145b48bd1c668d38fea28-3b651932e5b14040","baggage":"sentry-trace_id=1fdb22bad04145b48bd1c668d38fea28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X25X8Q6683VGDNW0AY99E6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:35.165Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-a3f18835f5fcb19b676e6477: done: 0.140199 sec","job_status":"done","queue_duration_s":63.095476,"scheduling_latency_s":63.095495,"redis_calls":11,"redis_duration_s":0.00204,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000442,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.116,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.116,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000319873,"duration_s":0.140199,"completed_at":"2026-10-26T21:35:38.400Z","load_balancing_strategy":"primary","db_duration_s":0.049038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1933gitlab # [ 272.345994] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.442Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0b35bb0f859791c966801075","created_at":"2026-10-26T21:34:35.167Z","trace_propagation_headers":{"sentry-trace":"1fdb22bad04145b48bd1c668d38fea28-3b651932e5b14040","baggage":"sentry-trace_id=1fdb22bad04145b48bd1c668d38fea28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X25X8Q6683VGDNW0AY99E6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:35.170Z","job_size_bytes":89,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0b35bb0f859791c966801075: start","job_status":"start","queue_duration_s":63.27202,"scheduling_latency_s":63.272071}1934gitlab # [ 272.386146] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.482Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0b35bb0f859791c966801075","created_at":"2026-10-26T21:34:35.167Z","trace_propagation_headers":{"sentry-trace":"1fdb22bad04145b48bd1c668d38fea28-3b651932e5b14040","baggage":"sentry-trace_id=1fdb22bad04145b48bd1c668d38fea28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X25X8Q6683VGDNW0AY99E6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:35.170Z","job_size_bytes":89,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0b35bb0f859791c966801075: done: 0.040595 sec","job_status":"done","queue_duration_s":63.27202,"scheduling_latency_s":63.272071,"redis_calls":11,"redis_duration_s":0.002927,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000864,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001535,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000528,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000398375,"duration_s":0.040595,"completed_at":"2026-10-26T21:35:38.482Z","load_balancing_strategy":"primary","db_duration_s":0.00619,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1935gitlab # [ 272.429281] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.525Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 9d78aeb7030807f8f740532b56c9ed68046a5bf3 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6a0a5374537d6e6765d59755","created_at":"2026-10-26T21:34:41.933Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-332bedb051b84c98","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:41.955Z","job_size_bytes":185,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6a0a5374537d6e6765d59755: start","job_status":"start","queue_duration_s":56.569565,"scheduling_latency_s":56.569614}1936gitlab # [ 272.455125] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:38.551Z","message":"changes: \"0000000000000000000000000000000000000000 9d78aeb7030807f8f740532b56c9ed68046a5bf3 refs/heads/master\\n\""}1937gitlab # [ 272.510594] gitaly[901]: time="2026-10-26T21:35:38.606Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:48.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:38.595" grpc.time_ms=11.618 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab # [ 272.539876] gitaly[901]: time="2026-10-26T21:35:38.636Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T21:35:48.037" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:35:38.627" grpc.time_ms=8.901 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 272.595424] gitaly[901]: time="2026-10-26T21:35:38.692Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-26T21:35:48.090" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:38.680" grpc.time_ms=11.473 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 272.671544] gitaly[901]: time="2026-10-26T21:35:38.768Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3930 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:38.767" grpc.time_ms=0.656 pid=901 span.kind=server system=grpc1941gitlab # [ 272.731603] gitaly[901]: time="2026-10-26T21:35:38.828Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3932 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:38.827" grpc.time_ms=0.458 pid=901 span.kind=server system=grpc1942gitlab # [ 272.759412] gitaly[901]: time="2026-10-26T21:35:38.856Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 diskcache=fe2b342f-c124-4472-8de6-214530d3c3a4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T21:35:48.140" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:35:38.731" pid=901 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1943gitlab # [ 272.760204] gitaly[901]: time="2026-10-26T21:35:38.856Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=111 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5200 command.oublock=8 command.real_time_ms=116 command.spawn_token_fork_ms=0 command.system_time_ms=78 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T21:35:48.140" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:35:38.731" grpc.time_ms=125.053 pid=901 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1944gitlab # [ 272.779943] gitaly[901]: time="2026-10-26T21:35:38.876Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T21:35:48.286" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:35:38.876" grpc.time_ms=0.121 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1945gitlab # [ 272.800418] gitaly[901]: time="2026-10-26T21:35:38.897Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=942 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-26T21:35:48.001" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:38.881" grpc.time_ms=15.825 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1946gitlab # [ 272.907811] gitaly[901]: time="2026-10-26T21:35:39.004Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-26T21:36:08.097" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:38.997" grpc.time_ms=7.131 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1947gitlab # [ 272.945953] gitaly[901]: time="2026-10-26T21:35:39.042Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T21:35:49.001" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:35:39.042" grpc.time_ms=0.366 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 272.966520] gitaly[901]: time="2026-10-26T21:35:39.054Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-26T21:35:49.005" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-26T21:35:39.045" grpc.time_ms=8.42 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 272.985219] gitaly[901]: time="2026-10-26T21:35:39.081Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:49.029" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:39.070" grpc.time_ms=11.785 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950gitlab # [ 273.002616] gitaly[901]: time="2026-10-26T21:35:39.099Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:49.048" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:39.088" grpc.time_ms=10.923 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab # [ 273.034711] gitaly[901]: time="2026-10-26T21:35:39.131Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-26T21:36:09.013" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:39.113" grpc.time_ms=17.599 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e'1953gitlab # [ 273.310415] nixbot[2751]: {"ts": "2026-10-26T21:35:39.406Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:57972 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1\" 200"}1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e', in 0.05 seconds)1955gitlab # [ 273.404175] gitaly[901]: time="2026-10-26T21:35:39.500Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-26T21:35:49.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:39.499" grpc.time_ms=1.117 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 273.430229] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:39.526Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 9d78aeb7030807f8f740532b56c9ed68046a5bf3 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6a0a5374537d6e6765d59755","created_at":"2026-10-26T21:34:41.933Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-332bedb051b84c98","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:34:41.955Z","job_size_bytes":185,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6a0a5374537d6e6765d59755: done: 1.000749 sec","job_status":"done","queue_duration_s":56.569565,"scheduling_latency_s":56.569614,"gitaly_calls":13,"gitaly_duration_s":0.314065,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.050163000000000006,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.00495,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.00738,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001723,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004799,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.019904,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.011407,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.192,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.225,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.059,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.567037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000957105,"exclusive_lock_hold_duration_s":0.040269086,"duration_s":1.000749,"completed_at":"2026-10-26T21:35:39.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.102826,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1957gitlab # [ 273.447701] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:39.527Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2cc1eb4d64df11fb96829bba","created_at":"2026-10-26T21:34:47.430Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-d20737dcd3434f93","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:47.439Z","job_size_bytes":65,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2cc1eb4d64df11fb96829bba: start","job_status":"start","queue_duration_s":52.088604,"scheduling_latency_s":52.088623}1958gitlab # [ 273.515873] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:39.593Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2cc1eb4d64df11fb96829bba","created_at":"2026-10-26T21:34:47.430Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-d20737dcd3434f93","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:47.439Z","job_size_bytes":65,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2cc1eb4d64df11fb96829bba: done: 0.066186 sec","job_status":"done","queue_duration_s":52.088604,"scheduling_latency_s":52.088623,"redis_calls":16,"redis_duration_s":0.0041259999999999995,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002133,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001568,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000382451,"duration_s":0.066186,"completed_at":"2026-10-26T21:35:39.593Z","load_balancing_strategy":"primary","db_duration_s":0.021803,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1959gitlab # [ 273.520292] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:39.595Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"08e5f2b05ceb2e632319e94d","created_at":"2026-10-26T21:34:47.440Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-d20737dcd3434f93","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:47.446Z","job_size_bytes":65,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-08e5f2b05ceb2e632319e94d: start","job_status":"start","queue_duration_s":52.14879,"scheduling_latency_s":52.148807}1960gitlab # [ 273.580646] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:39.677Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"08e5f2b05ceb2e632319e94d","created_at":"2026-10-26T21:34:47.440Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-d20737dcd3434f93","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:47.446Z","job_size_bytes":65,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-08e5f2b05ceb2e632319e94d: done: 0.081763 sec","job_status":"done","queue_duration_s":52.14879,"scheduling_latency_s":52.148807,"redis_calls":21,"redis_duration_s":0.0044740000000000005,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002341,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001154,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000242489,"duration_s":0.081763,"completed_at":"2026-10-26T21:35:39.677Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1961gitlab # [ 273.582404] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:39.678Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"075ed50caf9db55093b94257","created_at":"2026-10-26T21:34:47.583Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-d20737dcd3434f93","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:47.587Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-075ed50caf9db55093b94257: start","job_status":"start","queue_duration_s":52.090805,"scheduling_latency_s":52.090821}1962gitlab # [ 273.794277] gitaly[901]: time="2026-10-26T21:35:39.890Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:39.889" grpc.time_ms=0.682 pid=901 span.kind=server system=grpc1963gitlab # [ 273.855408] gitaly[901]: time="2026-10-26T21:35:39.952Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3889 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:39.951" grpc.time_ms=0.501 pid=901 span.kind=server system=grpc1964gitlab # [ 273.903174] gitaly[901]: time="2026-10-26T21:35:40.000Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:39.999" grpc.time_ms=0.293 pid=901 span.kind=server system=grpc1965gitlab # [ 273.922812] gitaly[901]: time="2026-10-26T21:35:40.019Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF diskcache=7ff9c061-5b3a-491c-88ad-6efb81f95b7f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T21:36:09.750" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:39.851" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 273.923676] gitaly[901]: time="2026-10-26T21:35:40.020Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=150 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7550 command.oublock=0 command.real_time_ms=159 command.spawn_token_fork_ms=0 command.system_time_ms=101 command.user_time_ms=49 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T21:36:09.750" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:39.851" grpc.time_ms=168.888 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1967gitlab # [ 274.068296] gitaly[901]: time="2026-10-26T21:35:40.165Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T21:36:10.063" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:40.163" grpc.time_ms=1.239 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab # [ 274.120709] gitaly[901]: time="2026-10-26T21:35:40.217Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X26A2JR7XB4AB9JX7SFPAF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:10.115" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:40.216" grpc.time_ms=1.021 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 274.138275] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.234Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"075ed50caf9db55093b94257","created_at":"2026-10-26T21:34:47.583Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-d20737dcd3434f93","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:47.587Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2628,"job_status":"rescheduled","message":"PipelineProcessWorker JID-075ed50caf9db55093b94257: rescheduled"}1970gitlab # [ 274.150537] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.246Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"075ed50caf9db55093b94257","created_at":"2026-10-26T21:34:47.583Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-d20737dcd3434f93","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T21:34:47.587Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-075ed50caf9db55093b94257: done: 0.568534 sec","job_status":"done","queue_duration_s":52.090805,"scheduling_latency_s":52.090821,"gitaly_calls":3,"gitaly_duration_s":0.200897,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.029509,"redis_read_bytes":460,"redis_write_bytes":29293,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001119,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001851,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010016,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004942,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15580,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007155,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000557,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000634,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002116,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.092,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.095,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.280049,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.515063786,"duration_s":0.568534,"completed_at":"2026-10-26T21:35:40.246Z","load_balancing_strategy":"primary","db_duration_s":0.067261,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1971gitlab # [ 274.187226] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.249Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","9d78aeb7030807f8f740532b56c9ed68046a5bf3 4dc27d6687154d1377fcf37da4b03c73c6fb685e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c7ef869b4c294966f8a14b53","created_at":"2026-10-26T21:35:37.178Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-4ee7a0a53708476f","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:35:37.179Z","job_size_bytes":185,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c7ef869b4c294966f8a14b53: start","job_status":"start","queue_duration_s":3.069225,"scheduling_latency_s":3.069253}1972gitlab # [ 274.226644] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.259Z","message":"changes: \"9d78aeb7030807f8f740532b56c9ed68046a5bf3 4dc27d6687154d1377fcf37da4b03c73c6fb685e refs/heads/master\\n\""}1973gitlab # [ 274.227546] gitaly[901]: time="2026-10-26T21:35:40.280Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:50.233" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:40.273" grpc.time_ms=6.617 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab # [ 274.269547] gitaly[901]: time="2026-10-26T21:35:40.366Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T21:35:50.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:35:40.360" grpc.time_ms=5.635 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab # [ 274.276499] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.373Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d763f0d8d1508a0e2a201027","created_at":"2026-10-26T21:35:40.370Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-4bb344ed0c134de9","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"f074e4c205b33762f5e93503","job_size_bytes":46,"pid":2628,"job_status":"deduplicated","message":"ProjectCacheWorker JID-d763f0d8d1508a0e2a201027: deduplicated: until executing","deduplication.type":"until executing"}1976gitlab # [ 274.300313] gitaly[901]: time="2026-10-26T21:35:40.397Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-26T21:35:50.040" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:40.390" grpc.time_ms=6.518 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1977gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e'1978gitlab # [ 274.318163] gitaly[901]: time="2026-10-26T21:35:40.415Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-26T21:36:10.301" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:40.401" grpc.time_ms=13.089 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979gitlab # [ 274.348224] gitaly[901]: time="2026-10-26T21:35:40.445Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-26T21:35:50.090" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-26T21:35:40.441" grpc.time_ms=3.932 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 274.369783] nixbot[2751]: {"ts": "2026-10-26T21:35:40.465Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:57978 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1\" 200"}1981gitlab # [ 274.370658] gitaly[901]: time="2026-10-26T21:35:40.467Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:50.106" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:40.456" grpc.time_ms=10.181 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e', in 0.07 seconds)1983gitlab # [ 274.475362] gitaly[901]: time="2026-10-26T21:35:40.572Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-26T21:35:50.080" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:40.570" grpc.time_ms=1.243 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 274.504328] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.599Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","9d78aeb7030807f8f740532b56c9ed68046a5bf3 4dc27d6687154d1377fcf37da4b03c73c6fb685e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c7ef869b4c294966f8a14b53","created_at":"2026-10-26T21:35:37.178Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-4ee7a0a53708476f","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T21:35:37.179Z","job_size_bytes":185,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c7ef869b4c294966f8a14b53: done: 0.350926 sec","job_status":"done","queue_duration_s":3.069225,"scheduling_latency_s":3.069253,"gitaly_calls":7,"gitaly_duration_s":0.156686,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.026425,"redis_read_bytes":501,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.002901,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001342,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003556,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.009456,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.00917,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.027,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.027,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.159123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000540012,"exclusive_lock_hold_duration_s":0.088899846,"duration_s":0.350926,"completed_at":"2026-10-26T21:35:40.599Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025407,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1985gitlab # [ 274.514277] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.602Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"f074e4c205b33762f5e93503","created_at":"2026-10-26T21:35:38.639Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-6db1bb15bc9e4c2c","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:38.659Z","job_size_bytes":46,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f074e4c205b33762f5e93503: start","job_status":"start","queue_duration_s":1.942615,"scheduling_latency_s":1.942647}1986gitlab # [ 274.550810] gitaly[901]: time="2026-10-26T21:35:40.647Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-27T03:35:40.641" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:35:40.642" grpc.time_ms=5.125 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1987gitlab # [ 274.563956] gitaly[901]: time="2026-10-26T21:35:40.661Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-26T21:36:10.553" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:40.653" grpc.time_ms=7.202 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988gitlab # [ 274.599318] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.695Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"f074e4c205b33762f5e93503","created_at":"2026-10-26T21:35:38.639Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-6db1bb15bc9e4c2c","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:38.659Z","job_size_bytes":46,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f074e4c205b33762f5e93503: done: 0.093802 sec","job_status":"done","queue_duration_s":1.942615,"scheduling_latency_s":1.942647,"gitaly_calls":2,"gitaly_duration_s":0.016762,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.0072,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001345,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000594,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001782,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002748,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000731,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000385524,"duration_s":0.093802,"completed_at":"2026-10-26T21:35:40.695Z","load_balancing_strategy":"primary","db_duration_s":0.012518,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1989gitlab # [ 274.643596] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.740Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"30a1e1d0d49e9164cf36c161","created_at":"2026-10-26T21:35:38.673Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-6db1bb15bc9e4c2c","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:38.676Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-30a1e1d0d49e9164cf36c161: start","job_status":"start","queue_duration_s":2.063365,"scheduling_latency_s":2.0634}1990gitlab # [ 274.700211] gitaly[901]: time="2026-10-26T21:35:40.797Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 diskcache=d438ec2e-0a9b-44bd-bf0b-4d639ba7fffb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-27T03:35:40.768" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:40.769" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab # [ 274.701086] gitaly[901]: time="2026-10-26T21:35:40.797Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1280 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-27T03:35:40.768" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:40.769" grpc.time_ms=27.825 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1992gitlab # [ 274.751653] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.848Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"30a1e1d0d49e9164cf36c161","created_at":"2026-10-26T21:35:38.673Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-6db1bb15bc9e4c2c","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:38.676Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-30a1e1d0d49e9164cf36c161: done: 0.10791 sec","job_status":"done","queue_duration_s":2.063365,"scheduling_latency_s":2.0634,"gitaly_calls":1,"gitaly_duration_s":0.030999,"redis_calls":15,"redis_duration_s":0.005084,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00066,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001853,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000856,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.024,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.074815096,"duration_s":0.10791,"completed_at":"2026-10-26T21:35:40.848Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1993gitlab # [ 274.773344] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.850Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"5c4d789819f748c907dc8678","created_at":"2026-10-26T21:35:38.871Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-6db1bb15bc9e4c2c","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:38.873Z","job_size_bytes":23,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5c4d789819f748c907dc8678: start","job_status":"start","queue_duration_s":1.976628,"scheduling_latency_s":1.976656}1994gitlab # [ 274.820622] gitaly[901]: time="2026-10-26T21:35:40.916Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-26T21:36:10.804" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:40.905" grpc.time_ms=11.427 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab # [ 274.835867] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.932Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"5c4d789819f748c907dc8678","created_at":"2026-10-26T21:35:38.871Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-6db1bb15bc9e4c2c","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:38.873Z","job_size_bytes":23,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5c4d789819f748c907dc8678: done: 0.081814 sec","job_status":"done","queue_duration_s":1.976628,"scheduling_latency_s":1.976656,"gitaly_calls":1,"gitaly_duration_s":0.037992,"redis_calls":16,"redis_duration_s":0.005614,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000524,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002479,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.081814,"completed_at":"2026-10-26T21:35:40.932Z","load_balancing_strategy":"primary","db_duration_s":0.003434,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1996gitlab # [ 274.879125] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:40.975Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8febb14bdc928d706e3889c7","created_at":"2026-10-26T21:35:39.371Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-6db1bb15bc9e4c2c","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b339089b1be1022b0f8ffefb114ad763b8d527290d0edcf7a7a09a551ff86730","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:39.376Z","job_size_bytes":467,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8febb14bdc928d706e3889c7: start","job_status":"start","queue_duration_s":1.599361,"scheduling_latency_s":1.599404}1997gitlab # [ 274.918088] gitaly[901]: time="2026-10-26T21:35:41.014Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:11.013" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:41.014" grpc.time_ms=0.716 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 274.939891] gitaly[901]: time="2026-10-26T21:35:41.036Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T21:35:51.016" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:41.027" grpc.time_ms=9.141 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 275.046729] gitaly[901]: time="2026-10-26T21:35:41.143Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T21:36:11.141" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:41.142" grpc.time_ms=1.137 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 275.080268] gitaly[901]: time="2026-10-26T21:35:41.177Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=32 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-26T21:36:11.173" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:41.173" grpc.time_ms=3.25 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 275.200804] gitaly[901]: time="2026-10-26T21:35:41.297Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:51.275" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:41.285" grpc.time_ms=12.039 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e'2003gitlab # [ 275.424769] nixbot[2751]: {"ts": "2026-10-26T21:35:41.520Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:57982 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1\" 200"}2004gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e', in 0.05 seconds)2005gitlab # [ 275.707510] gitaly[901]: time="2026-10-26T21:35:41.804Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-26T21:36:11.794" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:41.794" grpc.time_ms=9.257 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2006gitlab # [ 275.734207] gitaly[901]: time="2026-10-26T21:35:41.831Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X2649C48N187T56AMEGWW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-26T21:36:11.821" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:41.821" grpc.time_ms=9.328 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007gitlab # [ 275.757079] sidekiq-cluster[2628]: {"severity":"WARN","time":"2026-10-26T21:35:41.853Z","class":"CreatePipelineWorker","correlation_id":"01M5X2649C48N187T56AMEGWW1","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"9d78aeb7030807f8f740532b56c9ed68046a5bf3","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"9d78aeb7030807f8f740532b56c9ed68046a5bf3","ref":"refs/heads/master"},"retry":0}2008gitlab # [ 275.764065] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:41.860Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8febb14bdc928d706e3889c7","created_at":"2026-10-26T21:35:39.371Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-6db1bb15bc9e4c2c","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b339089b1be1022b0f8ffefb114ad763b8d527290d0edcf7a7a09a551ff86730","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:39.376Z","job_size_bytes":467,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8febb14bdc928d706e3889c7: done: 0.885187 sec","job_status":"done","queue_duration_s":1.599361,"scheduling_latency_s":1.599404,"gitaly_calls":7,"gitaly_duration_s":0.175505,"redis_calls":51,"redis_duration_s":0.011949,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00095,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005005,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001441,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003645,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.671622,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000322388,"duration_s":0.885187,"completed_at":"2026-10-26T21:35:41.860Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.051546,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2009gitlab # [ 275.768822] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:41.862Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"bb1852fb-7a0f-4588-a4d6-0cf636310058\"}"],"class":"WebHookWorker","jid":"324dd9fe8daecbbcd5a1d1a3","created_at":"2026-10-26T21:35:39.473Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-6db1bb15bc9e4c2c","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bc2f9ecb6d07c864ef9229e9eaa2ccedd9137991c183f48d73782d0224373fc","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:39.478Z","job_size_bytes":1751,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-324dd9fe8daecbbcd5a1d1a3: start","job_status":"start","queue_duration_s":2.383107,"scheduling_latency_s":2.383125}2010gitlab # [ 275.906720] nixbot[2751]: {"ts": "2026-10-26T21:35:42.003Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "6d49b571-ed3b-47e7-9ced-9b22e6f8527d", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "9d78aeb7030807f8f740532b56c9ed68046a5bf3", "pr": null}2011gitlab # [ 275.920345] nixbot[2751]: {"ts": "2026-10-26T21:35:42.017Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:57984 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}2012gitlab # [ 275.943678] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.039Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"bb1852fb-7a0f-4588-a4d6-0cf636310058\"}"],"class":"WebHookWorker","jid":"324dd9fe8daecbbcd5a1d1a3","created_at":"2026-10-26T21:35:39.473Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-6db1bb15bc9e4c2c","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bc2f9ecb6d07c864ef9229e9eaa2ccedd9137991c183f48d73782d0224373fc","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:39.478Z","job_size_bytes":1751,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-324dd9fe8daecbbcd5a1d1a3: done: 0.177827 sec","job_status":"done","queue_duration_s":2.383107,"scheduling_latency_s":2.383125,"redis_calls":19,"redis_duration_s":0.003788,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001026,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000344,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001556,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.049747383999999784,"cpu_s":0.074951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000588623,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.177827,"completed_at":"2026-10-26T21:35:42.039Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002278,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2013gitlab # [ 275.954324] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.042Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"657ef70b1c4a8393772b7fdd","created_at":"2026-10-26T21:35:39.838Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:39.842Z","job_size_bytes":23,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-657ef70b1c4a8393772b7fdd: start","job_status":"start","queue_duration_s":2.200403,"scheduling_latency_s":2.200437}2014gitlab # [ 276.038191] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.134Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"657ef70b1c4a8393772b7fdd","created_at":"2026-10-26T21:35:39.838Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:39.842Z","job_size_bytes":23,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-657ef70b1c4a8393772b7fdd: done: 0.092284 sec","job_status":"done","queue_duration_s":2.200403,"scheduling_latency_s":2.200437,"redis_calls":10,"redis_duration_s":0.00322,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000619,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001994,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000607,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000327137,"duration_s":0.092284,"completed_at":"2026-10-26T21:35:42.134Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01171,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2015gitlab # [ 276.040690] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.137Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4d5ab73c77963f57eed9fbba","created_at":"2026-10-26T21:35:40.045Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.050Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4d5ab73c77963f57eed9fbba: start","job_status":"start","queue_duration_s":2.08665,"scheduling_latency_s":2.086673}2016gitlab # [ 276.087673] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.173Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4d5ab73c77963f57eed9fbba","created_at":"2026-10-26T21:35:40.045Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.050Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4d5ab73c77963f57eed9fbba: done: 0.035452 sec","job_status":"done","queue_duration_s":2.08665,"scheduling_latency_s":2.086673,"redis_calls":10,"redis_duration_s":0.0030960000000000002,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00038,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001525,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000274616,"duration_s":0.035452,"completed_at":"2026-10-26T21:35:42.173Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2017gitlab # [ 276.093765] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.174Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cb07854f766f51d8e61bab30","created_at":"2026-10-26T21:35:40.061Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.067Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cb07854f766f51d8e61bab30: start","job_status":"start","queue_duration_s":2.106211,"scheduling_latency_s":2.10623}2018gitlab # [ 276.108697] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.204Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cb07854f766f51d8e61bab30","created_at":"2026-10-26T21:35:40.061Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.067Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cb07854f766f51d8e61bab30: done: 0.029872 sec","job_status":"done","queue_duration_s":2.106211,"scheduling_latency_s":2.10623,"redis_calls":10,"redis_duration_s":0.0028199999999999996,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000511,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001966,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000343,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000283835,"duration_s":0.029872,"completed_at":"2026-10-26T21:35:42.203Z","load_balancing_strategy":"primary","db_duration_s":0.005859,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2019gitlab # [ 276.161393] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.205Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d1928968b72742c05cf8fdbf","created_at":"2026-10-26T21:35:40.088Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.095Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d1928968b72742c05cf8fdbf: start","job_status":"start","queue_duration_s":2.110424,"scheduling_latency_s":2.110441}2020gitlab # [ 276.162386] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.240Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d1928968b72742c05cf8fdbf","created_at":"2026-10-26T21:35:40.088Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.095Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d1928968b72742c05cf8fdbf: done: 0.035008 sec","job_status":"done","queue_duration_s":2.110424,"scheduling_latency_s":2.110441,"redis_calls":13,"redis_duration_s":0.002366,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000447,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000462,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238298,"duration_s":0.035008,"completed_at":"2026-10-26T21:35:42.240Z","load_balancing_strategy":"primary","db_duration_s":0.005827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021gitlab # [ 276.219451] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.241Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"36ca9ce605f822032a2a7cb2","created_at":"2026-10-26T21:35:40.095Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.101Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-36ca9ce605f822032a2a7cb2: start","job_status":"start","queue_duration_s":2.140085,"scheduling_latency_s":2.140101}2022gitlab # [ 276.220557] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 822023gitlab # [ 276.222199] gitlab-workhorse[826]: time="2026-10-26T21:35:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672024gitlab # [ 276.224331] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 472025gitlab # [ 276.226187] gitaly[901]: time="2026-10-26T21:35:42.216Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X2801PVW680MNKZG32SD7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:42.208" grpc.time_ms=7.242 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2026gitlab # [ 276.237884] gitaly[901]: time="2026-10-26T21:35:42.266Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X2804B1T6WBWWDKB0AEK74 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:42.257" pid=901 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2027gitlab # [ 276.247594] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.272Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"36ca9ce605f822032a2a7cb2","created_at":"2026-10-26T21:35:40.095Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.101Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-36ca9ce605f822032a2a7cb2: done: 0.030653 sec","job_status":"done","queue_duration_s":2.140085,"scheduling_latency_s":2.140101,"redis_calls":10,"redis_duration_s":0.004937,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00074,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001333409,"duration_s":0.030653,"completed_at":"2026-10-26T21:35:42.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2028gitlab # [ 276.302077] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.275Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8444d292b93736ba091808d6","created_at":"2026-10-26T21:35:40.102Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.108Z","job_size_bytes":19,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8444d292b93736ba091808d6: start","job_status":"start","queue_duration_s":2.167123,"scheduling_latency_s":2.167142}2029gitlab # [ 276.302827] gitaly[901]: time="2026-10-26T21:35:42.266Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2804B1T6WBWWDKB0AEK74 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:42.257" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2030gitlab # [ 276.315549] gitlab-workhorse[826]: time="2026-10-26T21:35:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3432031gitlab # [ 276.317424] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 343 "" "git/2.55.0" 572032gitlab # [ 276.319127] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.306Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8444d292b93736ba091808d6","created_at":"2026-10-26T21:35:40.102Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.108Z","job_size_bytes":19,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8444d292b93736ba091808d6: done: 0.030707 sec","job_status":"done","queue_duration_s":2.167123,"scheduling_latency_s":2.167142,"redis_calls":11,"redis_duration_s":0.004706,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000392,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003965,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002254477,"duration_s":0.030707,"completed_at":"2026-10-26T21:35:42.306Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003755,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033gitlab # [ 276.368081] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.308Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"fe3c5b92dd8fc0c16c455d45","created_at":"2026-10-26T21:35:40.113Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.118Z","job_size_bytes":66,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-fe3c5b92dd8fc0c16c455d45: start","job_status":"start","queue_duration_s":2.189487,"scheduling_latency_s":2.18953}2034gitlab # [ 276.410854] gitaly[901]: time="2026-10-26T21:35:42.266Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2804B1T6WBWWDKB0AEK74 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:42.257" grpc.time_ms=9.195 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2035gitlab # [ 276.411752] nixbot[2751]: {"ts": "2026-10-26T21:35:42.496Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e'2037gitlab # [ 276.412271] nixbot[2751]: {"ts": "2026-10-26T21:35:42.498Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "9d78aeb7030807f8f740532b56c9ed68046a5bf3"}2038gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e', in 0.04 seconds)2039gitlab # [ 276.412752] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.338Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"fe3c5b92dd8fc0c16c455d45","created_at":"2026-10-26T21:35:40.113Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.118Z","job_size_bytes":66,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-fe3c5b92dd8fc0c16c455d45: done: 0.030107 sec","job_status":"done","queue_duration_s":2.189487,"scheduling_latency_s":2.18953,"redis_calls":10,"redis_duration_s":0.001838,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000457,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028635,"duration_s":0.030107,"completed_at":"2026-10-26T21:35:42.338Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2040gitlab # [ 276.436129] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.339Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5b15a22cee42159e8f0f1a0a","created_at":"2026-10-26T21:35:40.119Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.125Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5b15a22cee42159e8f0f1a0a: start","job_status":"start","queue_duration_s":2.214334,"scheduling_latency_s":2.214351}2041gitlab # [ 276.450897] gitaly[901]: time="2026-10-26T21:35:42.326Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X2805ZM09K4Y38968NNS8G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:42.312" pid=901 remote_ip="2001:db8:1::1" request_sha=12f2b6815f67e77a7dc357f9d6f251316d928d90 response_bytes=343 span.kind=server system=grpc2042gitlab # [ 276.497716] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.397Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5b15a22cee42159e8f0f1a0a","created_at":"2026-10-26T21:35:40.119Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.125Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5b15a22cee42159e8f0f1a0a: done: 0.057966 sec","job_status":"done","queue_duration_s":2.214334,"scheduling_latency_s":2.214351,"redis_calls":10,"redis_duration_s":0.007816,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00659,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000328,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238857,"duration_s":0.057966,"completed_at":"2026-10-26T21:35:42.397Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2043gitlab # [ 276.501585] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.400Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5c1a8693aa40b768f566a458","created_at":"2026-10-26T21:35:40.132Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.136Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5c1a8693aa40b768f566a458: start","job_status":"start","queue_duration_s":2.263395,"scheduling_latency_s":2.263424}2044gitlab # [ 276.544989] nixbot[2751]: {"ts": "2026-10-26T21:35:42.569Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:57998 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1\" 200"}2045gitlab # [ 276.545678] gitaly[901]: time="2026-10-26T21:35:42.326Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1189 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2805ZM09K4Y38968NNS8G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:42.312" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2046gitlab # [ 276.546530] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.432Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5c1a8693aa40b768f566a458","created_at":"2026-10-26T21:35:40.132Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.136Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5c1a8693aa40b768f566a458: done: 0.032557 sec","job_status":"done","queue_duration_s":2.263395,"scheduling_latency_s":2.263424,"redis_calls":10,"redis_duration_s":0.001582,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234946,"duration_s":0.032557,"completed_at":"2026-10-26T21:35:42.432Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2047gitlab # [ 276.600728] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.433Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"096a3f25661f0128a02a1918","created_at":"2026-10-26T21:35:40.137Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.142Z","job_size_bytes":6,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-096a3f25661f0128a02a1918: start","job_status":"start","queue_duration_s":2.291465,"scheduling_latency_s":2.291482}2048gitlab # [ 276.601730] gitaly[901]: time="2026-10-26T21:35:42.328Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1189 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2805ZM09K4Y38968NNS8G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:42.312" grpc.time_ms=15.75 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2049gitlab # [ 276.603797] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9d78aeb7030807f8f740532b56c9ed68046a5bf3 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1452050gitlab # [ 276.606363] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.450Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"096a3f25661f0128a02a1918","created_at":"2026-10-26T21:35:40.137Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.142Z","job_size_bytes":6,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-096a3f25661f0128a02a1918: done: 0.016595 sec","job_status":"done","queue_duration_s":2.291465,"scheduling_latency_s":2.291482,"redis_calls":10,"redis_duration_s":0.001363,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000265676,"duration_s":0.016595,"completed_at":"2026-10-26T21:35:42.450Z","load_balancing_strategy":"primary","db_duration_s":0.001486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2051gitlab # [ 276.650669] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.451Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ce58d9d35f0ccac51bf5a6e4","created_at":"2026-10-26T21:35:40.142Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.146Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ce58d9d35f0ccac51bf5a6e4: start","job_status":"start","queue_duration_s":2.305447,"scheduling_latency_s":2.305464}2052gitlab # [ 276.663994] gitaly[901]: time="2026-10-26T21:35:42.559Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X280DEFSXV64MG0NKGCT90 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:12.358" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:42.559" grpc.time_ms=0.583 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 276.708138] gitaly[901]: time="2026-10-26T21:35:42.590Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 diskcache=79634646-e1fb-49f1-a509-417ebccb6d97 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-27T03:35:42.579" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:42.579" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 276.708997] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.479Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ce58d9d35f0ccac51bf5a6e4","created_at":"2026-10-26T21:35:40.142Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.146Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ce58d9d35f0ccac51bf5a6e4: done: 0.028109 sec","job_status":"done","queue_duration_s":2.305447,"scheduling_latency_s":2.305464,"redis_calls":10,"redis_duration_s":0.001631,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000301156,"duration_s":0.028109,"completed_at":"2026-10-26T21:35:42.479Z","load_balancing_strategy":"primary","db_duration_s":0.004871,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2055gitlab # [ 276.763127] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.482Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"f86c7254ce895d21b63681f5","created_at":"2026-10-26T21:35:40.150Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.154Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-f86c7254ce895d21b63681f5: start","job_status":"start","queue_duration_s":2.328441,"scheduling_latency_s":2.328462}2056gitlab # [ 276.763861] gitaly[901]: time="2026-10-26T21:35:42.590Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-27T03:35:42.579" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:42.579" grpc.time_ms=10.476 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057gitlab # [ 276.764537] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9d78aeb7030807f8f740532b56c9ed68046a5bf3 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1952058gitlab # [ 276.766823] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.534Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"f86c7254ce895d21b63681f5","created_at":"2026-10-26T21:35:40.150Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.154Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-f86c7254ce895d21b63681f5: done: 0.05181 sec","job_status":"done","queue_duration_s":2.328441,"scheduling_latency_s":2.328462,"redis_calls":14,"redis_duration_s":0.005487,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004018,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000293613,"duration_s":0.05181,"completed_at":"2026-10-26T21:35:42.534Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2059gitlab # [ 276.843138] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.535Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"200e8a47b6787d323ae60068","created_at":"2026-10-26T21:35:40.235Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.237Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-200e8a47b6787d323ae60068: start","job_status":"start","queue_duration_s":2.297951,"scheduling_latency_s":2.29797}2060gitlab # [ 276.843913] gitaly[901]: time="2026-10-26T21:35:42.611Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X280DEFSXV64MG0NKGCT90 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:52.234" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:42.604" grpc.time_ms=6.482 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 276.844609] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.558Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"200e8a47b6787d323ae60068","created_at":"2026-10-26T21:35:40.235Z","trace_propagation_headers":{"sentry-trace":"86a2649ed977466caf7fff7f652b0869-b58925489dff443b","baggage":"sentry-trace_id=86a2649ed977466caf7fff7f652b0869,sentry-release=Unknown"},"correlation_id":"01M5X26A2JR7XB4AB9JX7SFPAF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.237Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-200e8a47b6787d323ae60068: done: 0.022437 sec","job_status":"done","queue_duration_s":2.297951,"scheduling_latency_s":2.29797,"redis_calls":8,"redis_duration_s":0.002288,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022437,"completed_at":"2026-10-26T21:35:42.558Z","load_balancing_strategy":"primary","db_duration_s":0.003879,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2062gitlab # [ 276.873195] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.560Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7f6630f1e3f0d1d6ef7a4f08","created_at":"2026-10-26T21:35:40.380Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-4bb344ed0c134de9","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"30a1e1d0d49e9164cf36c161","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.383Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7f6630f1e3f0d1d6ef7a4f08: start","job_status":"start","queue_duration_s":2.177018,"scheduling_latency_s":2.177053}2063gitlab # [ 276.927359] gitaly[901]: time="2026-10-26T21:35:42.625Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:12.624" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:42.624" grpc.time_ms=0.405 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2064gitlab # [ 276.928052] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9d78aeb7030807f8f740532b56c9ed68046a5bf3 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1442065gitlab # [ 276.928214] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.607Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7f6630f1e3f0d1d6ef7a4f08","created_at":"2026-10-26T21:35:40.380Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-4bb344ed0c134de9","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"30a1e1d0d49e9164cf36c161","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.383Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7f6630f1e3f0d1d6ef7a4f08: done: 0.047169 sec","job_status":"done","queue_duration_s":2.177018,"scheduling_latency_s":2.177053,"gitaly_calls":1,"gitaly_duration_s":0.012475,"redis_calls":12,"redis_duration_s":0.00203,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000419,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.029196169,"duration_s":0.047169,"completed_at":"2026-10-26T21:35:42.607Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2066gitlab # [ 276.989326] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:42.609Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4618f9d830918b9e53d5a0cb","created_at":"2026-10-26T21:35:40.530Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-4bb344ed0c134de9","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aef5f580715c1913e6313ab4975c38f6a838e329d9457f4123b1478f4ce3f870","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.533Z","job_size_bytes":467,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4618f9d830918b9e53d5a0cb: start","job_status":"start","queue_duration_s":2.075682,"scheduling_latency_s":2.075698}2067gitlab # [ 276.989665] gitaly[901]: time="2026-10-26T21:35:42.631Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T21:35:52.136" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:42.626" grpc.time_ms=5.13 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 276.990597] gitaly[901]: time="2026-10-26T21:35:42.658Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T21:36:12.657" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:42.657" grpc.time_ms=0.627 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 276.991908] gitaly[901]: time="2026-10-26T21:35:42.664Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=266 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-26T21:36:12.660" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:42.661" grpc.time_ms=3.326 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070gitlab # [ 277.049138] gitaly[901]: time="2026-10-26T21:35:42.687Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:52.190" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:42.681" grpc.time_ms=5.772 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 277.050184] nixbot[2751]: {"ts": "2026-10-26T21:35:43.129Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "e34c02ab-2ac9-4b88-9ced-6f211c8f39d6", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "4dc27d6687154d1377fcf37da4b03c73c6fb685e", "pr": null}2072gitlab # [ 277.051271] nixbot[2751]: {"ts": "2026-10-26T21:35:43.131Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58000 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}2073gitlab # [ 277.051846] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 482074gitlab # [ 277.052791] sidekiq-cluster[2628]: {"severity":"WARN","time":"2026-10-26T21:35:43.104Z","class":"CreatePipelineWorker","correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"9d78aeb7030807f8f740532b56c9ed68046a5bf3","after":"4dc27d6687154d1377fcf37da4b03c73c6fb685e","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4dc27d6687154d1377fcf37da4b03c73c6fb685e","ref":"refs/heads/master"},"retry":0}2075gitlab # [ 277.053461] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.108Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4618f9d830918b9e53d5a0cb","created_at":"2026-10-26T21:35:40.530Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-4bb344ed0c134de9","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aef5f580715c1913e6313ab4975c38f6a838e329d9457f4123b1478f4ce3f870","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.533Z","job_size_bytes":467,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4618f9d830918b9e53d5a0cb: done: 0.49933 sec","job_status":"done","queue_duration_s":2.075682,"scheduling_latency_s":2.075698,"gitaly_calls":7,"gitaly_duration_s":0.047002,"redis_calls":33,"redis_duration_s":0.003872,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000539,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001877,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.425193,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.49933,"completed_at":"2026-10-26T21:35:43.108Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013658,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2076gitlab # [ 277.103428] gitaly[901]: time="2026-10-26T21:35:42.780Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X280J6NDHQEE3YJRN30E3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:12.578" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:42.779" grpc.time_ms=1.064 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 277.104056] gitlab-workhorse[826]: time="2026-10-26T21:35:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672078gitlab # [ 277.105196] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 572079gitlab # [ 277.105854] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.109Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"13961b17-9253-43c9-a538-6b9500384710\"}"],"class":"WebHookWorker","jid":"9beaff07197fa87541b2fbcf","created_at":"2026-10-26T21:35:40.553Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-4bb344ed0c134de9","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:225b6dcb890d7c78ed141baee221c9ddda01f10f4d7a8a41742e9d35d0b4a38e","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.556Z","job_size_bytes":1749,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-9beaff07197fa87541b2fbcf: start","job_status":"start","queue_duration_s":2.553645,"scheduling_latency_s":2.553664}2080gitlab # [ 277.149215] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.139Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"13961b17-9253-43c9-a538-6b9500384710\"}"],"class":"WebHookWorker","jid":"9beaff07197fa87541b2fbcf","created_at":"2026-10-26T21:35:40.553Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-4bb344ed0c134de9","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:225b6dcb890d7c78ed141baee221c9ddda01f10f4d7a8a41742e9d35d0b4a38e","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.556Z","job_size_bytes":1749,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-9beaff07197fa87541b2fbcf: done: 0.02981 sec","job_status":"done","queue_duration_s":2.553645,"scheduling_latency_s":2.553664,"redis_calls":14,"redis_duration_s":0.002715,"redis_read_bytes":25,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000215,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001912,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.005794591000039873,"cpu_s":0.016576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.02981,"completed_at":"2026-10-26T21:35:43.139Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2081gitlab # [ 277.198957] gitaly[901]: time="2026-10-26T21:35:42.816Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X280J6NDHQEE3YJRN30E3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:52.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:42.808" grpc.time_ms=8.134 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 277.199793] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 592083gitlab # [ 277.200434] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.140Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"9a0b9f406722873f42922d81","created_at":"2026-10-26T21:35:40.675Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-08132f6287d24573","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.681Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-9a0b9f406722873f42922d81: start","job_status":"start","queue_duration_s":2.459498,"scheduling_latency_s":2.459516}2084gitlab # [ 277.201089] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.184Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"9a0b9f406722873f42922d81","created_at":"2026-10-26T21:35:40.675Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-08132f6287d24573","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:40.681Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-9a0b9f406722873f42922d81: done: 0.043858 sec","job_status":"done","queue_duration_s":2.459498,"scheduling_latency_s":2.459516,"redis_calls":19,"redis_duration_s":0.004621,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001103,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.001387,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001608,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007600966,"duration_s":0.043858,"completed_at":"2026-10-26T21:35:43.184Z","load_balancing_strategy":"primary","db_duration_s":0.006553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2085gitlab # [ 277.244379] gitaly[901]: time="2026-10-26T21:35:42.913Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X280RNJRDPWVKMP93E7K9Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:12.412" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:42.912" grpc.time_ms=0.932 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 277.245337] gitlab-workhorse[826]: time="2026-10-26T21:35:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672087gitlab # [ 277.246802] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 592088gitlab # [ 277.248667] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.186Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","324dd9fe8daecbbcd5a1d1a3"],"class":"WebHooks::LogExecutionWorker","jid":"6820e045cc4c3c9bed80d444","created_at":"2026-10-26T21:35:42.020Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-4fed9ddb6c86466f","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5e89f8c631c17c7fb6455abeb874898625a8ed75f68865af9838351ba913c1cb","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:42.028Z","job_size_bytes":2593,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-6820e045cc4c3c9bed80d444: start","job_status":"start","queue_duration_s":1.158092,"scheduling_latency_s":1.158109}2089gitlab # [ 277.295770] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.226Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","324dd9fe8daecbbcd5a1d1a3"],"class":"WebHooks::LogExecutionWorker","jid":"6820e045cc4c3c9bed80d444","created_at":"2026-10-26T21:35:42.020Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-4fed9ddb6c86466f","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5e89f8c631c17c7fb6455abeb874898625a8ed75f68865af9838351ba913c1cb","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:42.028Z","job_size_bytes":2593,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-6820e045cc4c3c9bed80d444: done: 0.040516 sec","job_status":"done","queue_duration_s":1.158092,"scheduling_latency_s":1.158109,"redis_calls":10,"redis_duration_s":0.002773,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000797,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000557,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000336356,"duration_s":0.040516,"completed_at":"2026-10-26T21:35:43.226Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2090gitlab # [ 277.340183] gitaly[901]: time="2026-10-26T21:35:42.963Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X280RNJRDPWVKMP93E7K9Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:52.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:42.955" grpc.time_ms=8.171 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 277.341334] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 502092gitlab # [ 277.341928] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 702093gitlab # [ 277.342812] gitlab-workhorse[826]: time="2026-10-26T21:35:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672094gitlab # [ 277.343536] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 562095gitlab # [ 277.344100] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.227Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7110d92c0919a22f42fc7a40","created_at":"2026-10-26T21:35:42.635Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-42610797994c41c4","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:42.639Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7110d92c0919a22f42fc7a40: start","job_status":"start","queue_duration_s":0.5886,"scheduling_latency_s":0.588616}2096gitlab # [ 277.345432] gitaly[901]: time="2026-10-26T21:35:43.081Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-26T21:36:13.070" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:43.071" grpc.time_ms=9.894 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab # [ 277.360655] gitaly[901]: time="2026-10-26T21:35:43.092Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X27TSKGBADKENBXQ4G18V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-26T21:36:13.083" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:43.083" grpc.time_ms=8.871 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 277.412216] gitaly[901]: time="2026-10-26T21:35:43.093Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X280Y5SMFJ1RKWCWMGK94J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.084" grpc.time_ms=9.437 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2099gitlab # [ 277.412842] gitaly[901]: time="2026-10-26T21:35:43.152Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X280ZR9SQY5SEJAG81F467 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.143" pid=901 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2100gitlab # [ 277.413595] gitlab-workhorse[826]: time="2026-10-26T21:35:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2212101gitlab # [ 277.415150] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 632102gitlab # [ 277.418240] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.467Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7110d92c0919a22f42fc7a40","created_at":"2026-10-26T21:35:42.635Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-42610797994c41c4","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:42.639Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2628,"job_status":"rescheduled","message":"PipelineProcessWorker JID-7110d92c0919a22f42fc7a40: rescheduled"}2103gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e'2104gitlab # [ 277.418882] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.474Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7110d92c0919a22f42fc7a40","created_at":"2026-10-26T21:35:42.635Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-42610797994c41c4","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:42.639Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7110d92c0919a22f42fc7a40: done: 0.246393 sec","job_status":"done","queue_duration_s":0.5886,"scheduling_latency_s":0.588616,"gitaly_calls":3,"gitaly_duration_s":0.098769,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.019278,"redis_read_bytes":148,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.00045,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000769,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.00279,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.010606,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000189,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001036,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002988,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093884,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.203794057,"duration_s":0.246393,"completed_at":"2026-10-26T21:35:43.474Z","load_balancing_strategy":"primary","db_duration_s":0.032385,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2105gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e', in 0.04 seconds)2106gitlab # [ 277.472955] gitaly[901]: time="2026-10-26T21:35:43.152Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X280ZR9SQY5SEJAG81F467 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.143" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2107gitlab # [ 277.476257] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 472108gitlab # [ 277.478201] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.475Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","9beaff07197fa87541b2fbcf"],"class":"WebHooks::LogExecutionWorker","jid":"12ed563e5b80daf90e2ad2a2","created_at":"2026-10-26T21:35:43.132Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-b878237789a2428f","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:504d2da6090dee3cf6ef3bc30456cbdc767aa2163a12d73d7584842703e3dd9d","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.135Z","job_size_bytes":2592,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-12ed563e5b80daf90e2ad2a2: start","job_status":"start","queue_duration_s":0.339662,"scheduling_latency_s":0.339684}2109gitlab # [ 277.494331] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.499Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","9beaff07197fa87541b2fbcf"],"class":"WebHooks::LogExecutionWorker","jid":"12ed563e5b80daf90e2ad2a2","created_at":"2026-10-26T21:35:43.132Z","trace_propagation_headers":{"sentry-trace":"c2c9ba2c49be43bba368822adf935d79-b878237789a2428f","baggage":"sentry-trace_id=c2c9ba2c49be43bba368822adf935d79,sentry-release=Unknown"},"correlation_id":"01M5X27TSKGBADKENBXQ4G18V1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:504d2da6090dee3cf6ef3bc30456cbdc767aa2163a12d73d7584842703e3dd9d","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.135Z","job_size_bytes":2592,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-12ed563e5b80daf90e2ad2a2: done: 0.024294 sec","job_status":"done","queue_duration_s":0.339662,"scheduling_latency_s":0.339684,"redis_calls":7,"redis_duration_s":0.002813,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002534,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024294,"completed_at":"2026-10-26T21:35:43.499Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2110gitlab # [ 277.537869] gitaly[901]: time="2026-10-26T21:35:43.153Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5X280ZR9SQY5SEJAG81F467 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.143" grpc.time_ms=9.268 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2111gitlab # [ 277.579315] nixbot[2751]: {"ts": "2026-10-26T21:35:43.610Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58006 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1\" 200"}2112gitlab # [ 277.580465] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.502Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"34e8c1631e023420276200a7","created_at":"2026-10-26T21:35:43.172Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-858b479b539f4faf","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.176Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-34e8c1631e023420276200a7: start","job_status":"start","queue_duration_s":0.325296,"scheduling_latency_s":0.325315}2113gitlab # [ 277.581142] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.578Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"34e8c1631e023420276200a7","created_at":"2026-10-26T21:35:43.172Z","trace_propagation_headers":{"sentry-trace":"f4ab54a62ce2415ea7177c007577a73f-858b479b539f4faf","baggage":"sentry-trace_id=f4ab54a62ce2415ea7177c007577a73f,sentry-release=Unknown"},"correlation_id":"01M5X2649C48N187T56AMEGWW1","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.176Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-34e8c1631e023420276200a7: done: 0.07605 sec","job_status":"done","queue_duration_s":0.325296,"scheduling_latency_s":0.325315,"redis_calls":11,"redis_duration_s":0.002535,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000986,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001257,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000282438,"duration_s":0.07605,"completed_at":"2026-10-26T21:35:43.577Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2114gitlab # [ 277.649317] gitlab-workhorse[826]: time="2026-10-26T21:35:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162115gitlab # [ 277.649938] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 542116gitlab # [ 277.650650] gitaly[901]: time="2026-10-26T21:35:43.236Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5X28129QJ2ADY690CXPSS43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.223" grpc.time_ms=12.799 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2117gitlab # [ 277.651540] gitaly[901]: time="2026-10-26T21:35:43.298Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X28147ZESN4PJ2KBQMC9KT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.289" pid=901 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2118gitlab # [ 277.652215] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.579Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"010596e8e9f284bc3392ac34","created_at":"2026-10-26T21:35:43.280Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.282Z","job_size_bytes":23,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-010596e8e9f284bc3392ac34: start","job_status":"start","queue_duration_s":0.297314,"scheduling_latency_s":0.29733}2119gitlab # [ 277.654936] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"010596e8e9f284bc3392ac34","created_at":"2026-10-26T21:35:43.280Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.282Z","job_size_bytes":23,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-010596e8e9f284bc3392ac34: done: 0.036278 sec","job_status":"done","queue_duration_s":0.297314,"scheduling_latency_s":0.29733,"redis_calls":7,"redis_duration_s":0.004036,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036278,"completed_at":"2026-10-26T21:35:43.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006422,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2120gitlab # [ 277.718395] gitaly[901]: time="2026-10-26T21:35:43.298Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X28147ZESN4PJ2KBQMC9KT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.289" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2121gitlab # [ 277.719059] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.617Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"04288d5dd937e88a8d6f7c0f","created_at":"2026-10-26T21:35:43.383Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.385Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-04288d5dd937e88a8d6f7c0f: start","job_status":"start","queue_duration_s":0.231887,"scheduling_latency_s":0.231909}2122gitlab # [ 277.760648] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.641Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"04288d5dd937e88a8d6f7c0f","created_at":"2026-10-26T21:35:43.383Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.385Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-04288d5dd937e88a8d6f7c0f: done: 0.02384 sec","job_status":"done","queue_duration_s":0.231887,"scheduling_latency_s":0.231909,"redis_calls":7,"redis_duration_s":0.001436,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000317,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02384,"completed_at":"2026-10-26T21:35:43.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2123gitlab # [ 277.766501] gitaly[901]: time="2026-10-26T21:35:43.299Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X28147ZESN4PJ2KBQMC9KT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.289" grpc.time_ms=9.263 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2124gitlab # [ 277.780755] nixbot[2751]: {"ts": "2026-10-26T21:35:43.858Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4dc27d668715-6"}2125gitlab # [ 277.782896] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.642Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dbb14d6116b9f3e6f8b0ce88","created_at":"2026-10-26T21:35:43.393Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.394Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dbb14d6116b9f3e6f8b0ce88: start","job_status":"start","queue_duration_s":0.247593,"scheduling_latency_s":0.247612}2126gitlab # [ 277.830896] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.665Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dbb14d6116b9f3e6f8b0ce88","created_at":"2026-10-26T21:35:43.393Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.394Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dbb14d6116b9f3e6f8b0ce88: done: 0.022944 sec","job_status":"done","queue_duration_s":0.247593,"scheduling_latency_s":0.247612,"redis_calls":7,"redis_duration_s":0.00187,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001563,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022944,"completed_at":"2026-10-26T21:35:43.665Z","load_balancing_strategy":"primary","db_duration_s":0.003303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2127gitlab # [ 277.838798] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 2302128gitlab # [ 277.841165] gitaly[901]: time="2026-10-26T21:35:43.313Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X280DEFSXV64MG0NKGCT90 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:43.311" grpc.time_ms=1.104 pid=901 span.kind=server system=grpc2129gitlab # [ 277.850434] gitaly[901]: time="2026-10-26T21:35:43.338Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X280DEFSXV64MG0NKGCT90 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3889 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:43.337" grpc.time_ms=0.315 pid=901 span.kind=server system=grpc2130gitlab # [ 277.860203] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.666Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1cfb207dcc2bcc0fcdfccb66","created_at":"2026-10-26T21:35:43.402Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.403Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1cfb207dcc2bcc0fcdfccb66: start","job_status":"start","queue_duration_s":0.263258,"scheduling_latency_s":0.263279}2131gitlab # [ 277.912307] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.695Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1cfb207dcc2bcc0fcdfccb66","created_at":"2026-10-26T21:35:43.402Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.403Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1cfb207dcc2bcc0fcdfccb66: done: 0.028319 sec","job_status":"done","queue_duration_s":0.263258,"scheduling_latency_s":0.263279,"redis_calls":10,"redis_duration_s":0.003966,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000434,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028319,"completed_at":"2026-10-26T21:35:43.695Z","load_balancing_strategy":"primary","db_duration_s":0.004767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2132gitlab # [ 277.916846] nixbot[2751]: {"ts": "2026-10-26T21:35:43.955Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4dc27d668715-6", "argv0": "bwrap"}2133gitlab # [ 277.919176] gitaly[901]: time="2026-10-26T21:35:43.367Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X280DEFSXV64MG0NKGCT90 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:43.366" grpc.time_ms=1.497 pid=901 span.kind=server system=grpc2134gitlab # [ 277.966238] gitaly[901]: time="2026-10-26T21:35:43.372Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X2816TKWEHT7PEB05Z0VCP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.361" grpc.time_ms=10.649 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2135gitlab # [ 277.966892] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.696Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5923df9f11b9f4af3c8c4d0e","created_at":"2026-10-26T21:35:43.403Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.405Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5923df9f11b9f4af3c8c4d0e: start","job_status":"start","queue_duration_s":0.290968,"scheduling_latency_s":0.290987}2136gitlab # [ 277.967545] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5923df9f11b9f4af3c8c4d0e","created_at":"2026-10-26T21:35:43.403Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.405Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5923df9f11b9f4af3c8c4d0e: done: 0.019691 sec","job_status":"done","queue_duration_s":0.290968,"scheduling_latency_s":0.290987,"redis_calls":7,"redis_duration_s":0.001294,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000353,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019691,"completed_at":"2026-10-26T21:35:43.715Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003201,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2137gitlab # [ 278.031327] gitaly[901]: time="2026-10-26T21:35:43.377Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5X280DEFSXV64MG0NKGCT90 diskcache=4b052020-2809-49dc-b728-b67bdc47910c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T21:36:13.286" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:43.286" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 278.031983] gitaly[901]: time="2026-10-26T21:35:43.377Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7138 command.oublock=0 command.real_time_ms=83 command.spawn_token_fork_ms=1 command.system_time_ms=33 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01M5X280DEFSXV64MG0NKGCT90 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T21:36:13.286" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:43.286" grpc.time_ms=90.408 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 278.032737] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.717Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"071f8fc7310f94934739a99d","created_at":"2026-10-26T21:35:43.405Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.408Z","job_size_bytes":19,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-071f8fc7310f94934739a99d: start","job_status":"start","queue_duration_s":0.308496,"scheduling_latency_s":0.308513}2140gitlab # [ 278.034616] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.737Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"071f8fc7310f94934739a99d","created_at":"2026-10-26T21:35:43.405Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.408Z","job_size_bytes":19,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-071f8fc7310f94934739a99d: done: 0.020721 sec","job_status":"done","queue_duration_s":0.308496,"scheduling_latency_s":0.308513,"redis_calls":8,"redis_duration_s":0.001242,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020721,"completed_at":"2026-10-26T21:35:43.737Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2141gitlab # [ 278.086854] gitaly[901]: time="2026-10-26T21:35:43.404Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X2817556SMRPQ53FCW2Q7D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.395" grpc.time_ms=9.495 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2142gitlab # [ 278.088341] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.738Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9eff6c73268a548364ae9a5f","created_at":"2026-10-26T21:35:43.409Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.411Z","job_size_bytes":66,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9eff6c73268a548364ae9a5f: start","job_status":"start","queue_duration_s":0.327837,"scheduling_latency_s":0.327855}2143gitlab # [ 278.107316] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.759Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9eff6c73268a548364ae9a5f","created_at":"2026-10-26T21:35:43.409Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.411Z","job_size_bytes":66,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9eff6c73268a548364ae9a5f: done: 0.020601 sec","job_status":"done","queue_duration_s":0.327837,"scheduling_latency_s":0.327855,"redis_calls":7,"redis_duration_s":0.0013989999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000416,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020601,"completed_at":"2026-10-26T21:35:43.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003182,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2144gitlab # [ 278.182905] gitaly[901]: time="2026-10-26T21:35:43.427Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X280DEFSXV64MG0NKGCT90 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T21:36:13.426" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:43.426" grpc.time_ms=0.649 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 278.183667] gitaly[901]: time="2026-10-26T21:35:43.428Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X2818DSH589631TNZ8BD2A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.416" pid=901 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2146gitlab # [ 278.184334] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.760Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"92704534c9f9736406be0b2a","created_at":"2026-10-26T21:35:43.411Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.412Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-92704534c9f9736406be0b2a: start","job_status":"start","queue_duration_s":0.348161,"scheduling_latency_s":0.348182}2147gitlab # [ 278.194280] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.782Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"92704534c9f9736406be0b2a","created_at":"2026-10-26T21:35:43.411Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.412Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-92704534c9f9736406be0b2a: done: 0.021446 sec","job_status":"done","queue_duration_s":0.348161,"scheduling_latency_s":0.348182,"redis_calls":7,"redis_duration_s":0.00119,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021446,"completed_at":"2026-10-26T21:35:43.782Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2148gitlab # [ 278.280146] gitaly[901]: time="2026-10-26T21:35:43.428Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2818DSH589631TNZ8BD2A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.416" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2149gitlab # [ 278.281131] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.783Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"813590b5da950747d2383744","created_at":"2026-10-26T21:35:43.413Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.414Z","job_size_bytes":6,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-813590b5da950747d2383744: start","job_status":"start","queue_duration_s":0.368839,"scheduling_latency_s":0.368858}2150gitlab # [ 278.281958] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.794Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"813590b5da950747d2383744","created_at":"2026-10-26T21:35:43.413Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.414Z","job_size_bytes":6,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-813590b5da950747d2383744: done: 0.011221 sec","job_status":"done","queue_duration_s":0.368839,"scheduling_latency_s":0.368858,"redis_calls":7,"redis_duration_s":0.001287,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000529,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011221,"completed_at":"2026-10-26T21:35:43.794Z","load_balancing_strategy":"primary","db_duration_s":0.000361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2151gitlab # [ 278.361639] gitaly[901]: time="2026-10-26T21:35:43.429Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2818DSH589631TNZ8BD2A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.416" grpc.time_ms=12.033 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2152gitlab # [ 278.362597] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.795Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5af5d5ecb6d1073e9b0cff1d","created_at":"2026-10-26T21:35:43.414Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.415Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5af5d5ecb6d1073e9b0cff1d: start","job_status":"start","queue_duration_s":0.379808,"scheduling_latency_s":0.379824}2153gitlab # [ 278.363429] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.818Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5af5d5ecb6d1073e9b0cff1d","created_at":"2026-10-26T21:35:43.414Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.415Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5af5d5ecb6d1073e9b0cff1d: done: 0.023163 sec","job_status":"done","queue_duration_s":0.379808,"scheduling_latency_s":0.379824,"redis_calls":7,"redis_duration_s":0.003271,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023163,"completed_at":"2026-10-26T21:35:43.818Z","load_balancing_strategy":"primary","db_duration_s":0.002729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2154gitlab # [ 278.444109] gitaly[901]: time="2026-10-26T21:35:43.452Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X280DEFSXV64MG0NKGCT90 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:13.451" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:43.451" grpc.time_ms=0.633 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 278.444898] gitaly[901]: time="2026-10-26T21:35:43.470Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X2819F36Q33382H0WVMJWZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.455" pid=901 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc2156gitlab # [ 278.445777] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.819Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"eb9a665c4354c107846c080a","created_at":"2026-10-26T21:35:43.467Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.469Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-eb9a665c4354c107846c080a: start","job_status":"start","queue_duration_s":0.350512,"scheduling_latency_s":0.350532}2157gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e'2158gitlab # [ 278.449060] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.842Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"eb9a665c4354c107846c080a","created_at":"2026-10-26T21:35:43.467Z","trace_propagation_headers":{"sentry-trace":"996dfec198284671bc69dc2aa85b278d-430e7a58445e441d","baggage":"sentry-trace_id=996dfec198284671bc69dc2aa85b278d,sentry-release=Unknown"},"correlation_id":"01M5X280DEFSXV64MG0NKGCT90","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.469Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-eb9a665c4354c107846c080a: done: 0.022477 sec","job_status":"done","queue_duration_s":0.350512,"scheduling_latency_s":0.350532,"redis_calls":8,"redis_duration_s":0.001172,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022477,"completed_at":"2026-10-26T21:35:43.842Z","load_balancing_strategy":"primary","db_duration_s":0.004269,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2159gitlab # [ 278.503067] gitaly[901]: time="2026-10-26T21:35:43.470Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1164 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2819F36Q33382H0WVMJWZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.455" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2160gitlab # [ 278.553807] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.843Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e9907e0c65620437c2ab2a32","created_at":"2026-10-26T21:35:43.783Z","trace_propagation_headers":{"sentry-trace":"217180b956e94c18a2107beae7c87fa0-7eba46a42df946ea","baggage":"sentry-trace_id=217180b956e94c18a2107beae7c87fa0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X281FZGP2KNHV56RBRPQPZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.786Z","job_size_bytes":65,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e9907e0c65620437c2ab2a32: start","job_status":"start","queue_duration_s":0.056733,"scheduling_latency_s":0.056753}2161gitlab # [ 278.554712] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.863Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e9907e0c65620437c2ab2a32","created_at":"2026-10-26T21:35:43.783Z","trace_propagation_headers":{"sentry-trace":"217180b956e94c18a2107beae7c87fa0-7eba46a42df946ea","baggage":"sentry-trace_id=217180b956e94c18a2107beae7c87fa0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X281FZGP2KNHV56RBRPQPZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.786Z","job_size_bytes":65,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e9907e0c65620437c2ab2a32: done: 0.020419 sec","job_status":"done","queue_duration_s":0.056733,"scheduling_latency_s":0.056753,"redis_calls":7,"redis_duration_s":0.001794,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000298,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020419,"completed_at":"2026-10-26T21:35:43.863Z","load_balancing_strategy":"primary","db_duration_s":0.00318,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2162gitlab # [ 278.582329] gitaly[901]: time="2026-10-26T21:35:43.470Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1164 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2819F36Q33382H0WVMJWZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.455" grpc.time_ms=15.703 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2163gitlab # [ 278.622120] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.865Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"850b75788781876f8b2f7833","created_at":"2026-10-26T21:35:43.787Z","trace_propagation_headers":{"sentry-trace":"217180b956e94c18a2107beae7c87fa0-7eba46a42df946ea","baggage":"sentry-trace_id=217180b956e94c18a2107beae7c87fa0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X281FZGP2KNHV56RBRPQPZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.789Z","job_size_bytes":65,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-850b75788781876f8b2f7833: start","job_status":"start","queue_duration_s":0.075651,"scheduling_latency_s":0.075691}2164gitlab # [ 278.622757] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.907Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"850b75788781876f8b2f7833","created_at":"2026-10-26T21:35:43.787Z","trace_propagation_headers":{"sentry-trace":"217180b956e94c18a2107beae7c87fa0-7eba46a42df946ea","baggage":"sentry-trace_id=217180b956e94c18a2107beae7c87fa0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X281FZGP2KNHV56RBRPQPZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.789Z","job_size_bytes":65,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-850b75788781876f8b2f7833: done: 0.041886 sec","job_status":"done","queue_duration_s":0.075651,"scheduling_latency_s":0.075691,"redis_calls":10,"redis_duration_s":0.002352,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041886,"completed_at":"2026-10-26T21:35:43.906Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab # [ 278.677880] gitaly[901]: time="2026-10-26T21:35:43.527Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X281BR454A93PW82G8DSZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.516" grpc.time_ms=10.865 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2166gitlab # [ 278.678659] gitaly[901]: time="2026-10-26T21:35:43.582Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5X281D9P68GWSC0N5ZRKWB1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.566" pid=901 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2167gitlab # [ 278.679363] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:43.908Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a34bcb34a271609378262e4a","created_at":"2026-10-26T21:35:43.830Z","trace_propagation_headers":{"sentry-trace":"217180b956e94c18a2107beae7c87fa0-7eba46a42df946ea","baggage":"sentry-trace_id=217180b956e94c18a2107beae7c87fa0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X281FZGP2KNHV56RBRPQPZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.833Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a34bcb34a271609378262e4a: start","job_status":"start","queue_duration_s":0.074628,"scheduling_latency_s":0.07465}2168gitlab # [ 278.686264] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:44.001Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a34bcb34a271609378262e4a","created_at":"2026-10-26T21:35:43.830Z","trace_propagation_headers":{"sentry-trace":"217180b956e94c18a2107beae7c87fa0-7eba46a42df946ea","baggage":"sentry-trace_id=217180b956e94c18a2107beae7c87fa0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X281FZGP2KNHV56RBRPQPZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.833Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a34bcb34a271609378262e4a: done: 0.093606 sec","job_status":"done","queue_duration_s":0.074628,"scheduling_latency_s":0.07465,"gitaly_calls":2,"gitaly_duration_s":0.006089,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007155,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001649,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000758,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000393,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001593,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000157,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000314,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000642,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063436,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.071533114,"duration_s":0.093606,"completed_at":"2026-10-26T21:35:44.001Z","load_balancing_strategy":"primary","db_duration_s":0.02124,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2169gitlab # [ 278.734788] gitaly[901]: time="2026-10-26T21:35:43.582Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X281D9P68GWSC0N5ZRKWB1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.566" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2170gitlab # [ 278.745536] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:44.003Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"15d4ffcc5fef59599660862a","created_at":"2026-10-26T21:35:43.950Z","trace_propagation_headers":{"sentry-trace":"217180b956e94c18a2107beae7c87fa0-8e0bff6cfcf44ceb","baggage":"sentry-trace_id=217180b956e94c18a2107beae7c87fa0,sentry-release=Unknown"},"correlation_id":"01M5X281FZGP2KNHV56RBRPQPZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.952Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-15d4ffcc5fef59599660862a: start","job_status":"start","queue_duration_s":0.050401,"scheduling_latency_s":0.050421}2171gitlab # [ 278.789405] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:44.040Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"15d4ffcc5fef59599660862a","created_at":"2026-10-26T21:35:43.950Z","trace_propagation_headers":{"sentry-trace":"217180b956e94c18a2107beae7c87fa0-8e0bff6cfcf44ceb","baggage":"sentry-trace_id=217180b956e94c18a2107beae7c87fa0,sentry-release=Unknown"},"correlation_id":"01M5X281FZGP2KNHV56RBRPQPZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:43.952Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-15d4ffcc5fef59599660862a: done: 0.037271 sec","job_status":"done","queue_duration_s":0.050401,"scheduling_latency_s":0.050421,"redis_calls":7,"redis_duration_s":0.001235,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037271,"completed_at":"2026-10-26T21:35:44.040Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00527,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2172gitlab # [ 278.798187] gitaly[901]: time="2026-10-26T21:35:43.583Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X281D9P68GWSC0N5ZRKWB1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:43.566" grpc.time_ms=17.161 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2173gitlab # [ 278.842743] gitaly[901]: time="2026-10-26T21:35:43.662Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:13.461" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:43.661" grpc.time_ms=0.921 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2174gitlab # [ 278.843654] gitaly[901]: time="2026-10-26T21:35:43.677Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-26T21:36:13.470" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:43.670" grpc.time_ms=6.127 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 278.844441] gitaly[901]: time="2026-10-26T21:35:43.688Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:35:53.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:43.681" grpc.time_ms=6.47 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 278.847710] gitaly[901]: time="2026-10-26T21:35:43.705Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T21:35:53.024" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:35:43.705" grpc.time_ms=0.196 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 278.857912] gitaly[901]: time="2026-10-26T21:35:43.714Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T21:35:53.027" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:43.707" grpc.time_ms=6.208 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 278.870230] gitaly[901]: time="2026-10-26T21:35:43.744Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4147 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:43.743" grpc.time_ms=0.347 pid=901 span.kind=server system=grpc2179gitlab # [ 278.879195] gitaly[901]: time="2026-10-26T21:35:43.768Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:43.768" grpc.time_ms=0.607 pid=901 span.kind=server system=grpc2180gitlab # [ 278.925837] gitaly[901]: time="2026-10-26T21:35:43.779Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ diskcache=8859e3ff-0bb7-44b1-b2aa-d72ddfeb5fb2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T21:35:53.035" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:35:43.715" pid=901 ref=refs/keep-around/4dc27d6687154d1377fcf37da4b03c73c6fb685e remote_ip="2001:db8:1::1" revision=4dc27d6687154d1377fcf37da4b03c73c6fb685e span.kind=server system=grpc username=root2181gitlab # [ 278.926665] gitaly[901]: time="2026-10-26T21:35:43.779Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=47 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5250 command.oublock=8 command.real_time_ms=55 command.spawn_token_fork_ms=0 command.system_time_ms=34 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T21:35:53.035" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T21:35:43.715" grpc.time_ms=63.413 pid=901 ref=refs/keep-around/4dc27d6687154d1377fcf37da4b03c73c6fb685e remote_ip="2001:db8:1::1" revision=4dc27d6687154d1377fcf37da4b03c73c6fb685e span.kind=server system=grpc username=root2182gitlab # [ 278.927459] gitaly[901]: time="2026-10-26T21:35:43.782Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:13.581" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:43.782" grpc.time_ms=0.334 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 278.928110] gitaly[901]: time="2026-10-26T21:35:43.967Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T21:36:13.065" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:43.966" grpc.time_ms=0.893 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 278.934947] gitaly[901]: time="2026-10-26T21:35:43.993Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X281FZGP2KNHV56RBRPQPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:13.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:43.993" grpc.time_ms=0.643 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2185gitlab # [ 279.013486] nixbot[2751]: {"ts": "2026-10-26T21:35:45.109Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58008 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1\" 200"}2186gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4dc27d6687154d1377fcf37da4b03c73c6fb685e', in 0.51 seconds)2187(finished: subtest: push delivers the webhook, in 59.43 seconds)2188subtest: eval and build post commit statuses2189gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses2190gitlab # [ 279.081165] nix-daemon[2918]: accepted connection from pid 3840, user nixbot2191gitlab # [ 279.123632] gitaly[901]: time="2026-10-26T21:35:45.220Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X282ZYB0HXMS31VKMSA9RY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:15.018" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:45.219" grpc.time_ms=0.915 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab # [ 279.160317] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1052193gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses, in 0.14 seconds)2194gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses2195gitlab # [ 280.285855] gitaly[901]: time="2026-10-26T21:35:46.381Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2843WZFQFP0R6MV9CDFBV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:16.079" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:46.380" grpc.time_ms=1.108 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab # [ 280.324705] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1192197gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses, in 0.16 seconds)2198gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses2199gitlab # [ 281.426678] gitaly[901]: time="2026-10-26T21:35:47.522Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X28583RX7HRJESQNM2KWD6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:17.320" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:47.521" grpc.time_ms=1.186 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2200gitlab # [ 281.452275] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 882201gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses, in 0.12 seconds)2202gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses2203gitlab # [ 282.557359] gitaly[901]: time="2026-10-26T21:35:48.653Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X286BDY9FKRZ53AREHKSE3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:18.451" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:48.652" grpc.time_ms=1.045 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 282.589579] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 952205gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses, in 0.14 seconds)2206gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses2207gitlab # [ 283.690829] gitaly[901]: time="2026-10-26T21:35:49.787Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X287EZTCGZ0FVRVCJMRFBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:19.485" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:49.785" grpc.time_ms=0.85 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2208gitlab # [ 283.737688] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1062209gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses, in 0.14 seconds)2210gitlab # [ 283.831279] nix-daemon[2918]: accepted connection from pid 3881, user nixbot2211gitlab # [ 283.843646] nix-daemon[2918]: accepted connection from pid 3840, user nixbot2212gitlab # [ 283.943104] gitaly[901]: time="2026-10-26T21:35:50.039Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:20.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:50.038" grpc.time_ms=1.007 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 283.985627] gitaly[901]: time="2026-10-26T21:35:50.082Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:36:00.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:50.072" grpc.time_ms=10.104 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2214gitlab # [ 284.016946] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.113Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"852ee96be9ab88d76c433fd1","created_at":"2026-10-26T21:35:50.107Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-8c65f12c4a2c458a","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.110Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-852ee96be9ab88d76c433fd1: start","job_status":"start","queue_duration_s":0.002407,"scheduling_latency_s":0.002457}2215gitlab # [ 284.037436] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1472216gitlab # [ 284.090434] gitaly[901]: time="2026-10-26T21:35:50.187Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X287VN3VANGJK083GVDRYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:20.085" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:50.185" grpc.time_ms=0.964 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2217gitlab # [ 284.146163] gitaly[901]: time="2026-10-26T21:35:50.242Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:50.241" grpc.time_ms=0.383 pid=901 span.kind=server system=grpc2218gitlab # [ 284.160776] gitaly[901]: time="2026-10-26T21:35:50.257Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X287VN3VANGJK083GVDRYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:36:00.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:50.251" grpc.time_ms=5.652 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2219gitlab # [ 284.211756] gitaly[901]: time="2026-10-26T21:35:50.308Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3889 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:50.307" grpc.time_ms=0.722 pid=901 span.kind=server system=grpc2220gitlab # [ 284.237486] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2002221gitlab # [ 284.240058] gitaly[901]: time="2026-10-26T21:35:50.337Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:50.336" grpc.time_ms=0.29 pid=901 span.kind=server system=grpc2222gitlab # [ 284.251731] gitaly[901]: time="2026-10-26T21:35:50.348Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T21:36:20.202" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:50.203" operations="[repack_refs]" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2223gitlab # [ 284.253467] gitaly[901]: time="2026-10-26T21:35:50.350Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T21:36:20.202" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:50.203" pid=901 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-26 21:34:34.398134516 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2224gitlab # [ 284.260488] gitaly[901]: time="2026-10-26T21:35:50.357Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 diskcache=fc92d9b1-1ee2-4897-9014-6577efe6097c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T21:36:20.202" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:50.203" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2225gitlab # [ 284.262045] gitaly[901]: time="2026-10-26T21:35:50.358Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=143 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7344 command.oublock=0 command.real_time_ms=146 command.spawn_token_fork_ms=0 command.system_time_ms=110 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T21:36:20.202" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:50.203" grpc.time_ms=154.912 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2226gitlab # [ 284.269098] gitaly[901]: time="2026-10-26T21:35:50.366Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T21:36:20.202" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:50.203" pid=901 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2227gitlab # [ 284.270044] gitaly[901]: time="2026-10-26T21:35:50.366Z" level=info msg="optimized repository" clean_stale_data_time=15.213386ms clean_work_trees_time="81.016µs" commit_graph_time="12.012µs" correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="5.029µs" pid=901 prune_time="3.632µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.75µs" storage_name=default system=housekeeping total_time=15.465653ms2228gitlab # [ 284.271259] gitaly[901]: time="2026-10-26T21:35:50.366Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T21:36:20.202" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:50.203" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2229gitlab # [ 284.307589] gitaly[901]: time="2026-10-26T21:35:50.404Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T21:36:20.403" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:50.403" grpc.time_ms=0.752 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2230gitlab # [ 284.328169] gitaly[901]: time="2026-10-26T21:35:50.425Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:20.424" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:50.424" grpc.time_ms=0.569 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2231gitlab # [ 284.334653] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.431Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5b34809c0cf85d150d24ab6f","created_at":"2026-10-26T21:35:50.430Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"852ee96be9ab88d76c433fd1","job_size_bytes":3,"pid":2628,"job_status":"deduplicated","message":"PipelineProcessWorker JID-5b34809c0cf85d150d24ab6f: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2232gitlab # [ 284.335759] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.432Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"852ee96be9ab88d76c433fd1","created_at":"2026-10-26T21:35:50.107Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-8c65f12c4a2c458a","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.110Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2628,"job_status":"rescheduled","message":"PipelineProcessWorker JID-852ee96be9ab88d76c433fd1: rescheduled"}2233gitlab # [ 284.340682] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.437Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"852ee96be9ab88d76c433fd1","created_at":"2026-10-26T21:35:50.107Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-8c65f12c4a2c458a","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.110Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-852ee96be9ab88d76c433fd1: done: 0.324282 sec","job_status":"done","queue_duration_s":0.002407,"scheduling_latency_s":0.002457,"gitaly_calls":3,"gitaly_duration_s":0.163108,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014984,"redis_read_bytes":239,"redis_write_bytes":21784,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001907,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001029,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003003,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14469,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.003975,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000424,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000367,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002372,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117339,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.285980201,"duration_s":0.324282,"completed_at":"2026-10-26T21:35:50.437Z","load_balancing_strategy":"primary","db_duration_s":0.033436,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2234gitlab # [ 284.384080] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d7b0aea10f5db26513b03ebf","created_at":"2026-10-26T21:35:50.196Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.198Z","job_size_bytes":23,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d7b0aea10f5db26513b03ebf: start","job_status":"start","queue_duration_s":0.24063,"scheduling_latency_s":0.240684}2235gitlab # [ 284.400212] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.474Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d7b0aea10f5db26513b03ebf","created_at":"2026-10-26T21:35:50.196Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.198Z","job_size_bytes":23,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d7b0aea10f5db26513b03ebf: done: 0.035508 sec","job_status":"done","queue_duration_s":0.24063,"scheduling_latency_s":0.240684,"redis_calls":7,"redis_duration_s":0.001209,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035508,"completed_at":"2026-10-26T21:35:50.474Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006237,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2236gitlab # [ 284.472785] gitaly[901]: time="2026-10-26T21:35:50.467Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5X2882BS2DGJHA545T3JYHE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T21:36:20.166" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T21:35:50.467" grpc.time_ms=0.5 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2237gitlab # [ 284.473643] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4dc27d6687154d1377fcf37da4b03c73c6fb685e HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1992238gitlab # [ 284.474204] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.475Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cd545387357da83017e21c8b","created_at":"2026-10-26T21:35:50.364Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.366Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cd545387357da83017e21c8b: start","job_status":"start","queue_duration_s":0.109126,"scheduling_latency_s":0.109147}2239gitlab # [ 284.474849] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.512Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cd545387357da83017e21c8b","created_at":"2026-10-26T21:35:50.364Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.366Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cd545387357da83017e21c8b: done: 0.03635 sec","job_status":"done","queue_duration_s":0.109126,"scheduling_latency_s":0.109147,"redis_calls":7,"redis_duration_s":0.0066,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03635,"completed_at":"2026-10-26T21:35:50.512Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007773,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2240gitlab # [ 284.516947] gitaly[901]: time="2026-10-26T21:35:50.510Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X2882BS2DGJHA545T3JYHE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T21:36:00.300" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T21:35:50.500" grpc.time_ms=10.164 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2241gitlab # [ 284.559803] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.513Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"80e070e8b6c6cf893c250b46","created_at":"2026-10-26T21:35:50.373Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.375Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-80e070e8b6c6cf893c250b46: start","job_status":"start","queue_duration_s":0.137922,"scheduling_latency_s":0.137943}2242gitlab # [ 284.560729] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.537Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"80e070e8b6c6cf893c250b46","created_at":"2026-10-26T21:35:50.373Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.375Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-80e070e8b6c6cf893c250b46: done: 0.023989 sec","job_status":"done","queue_duration_s":0.137922,"scheduling_latency_s":0.137943,"redis_calls":7,"redis_duration_s":0.0017009999999999998,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023989,"completed_at":"2026-10-26T21:35:50.537Z","load_balancing_strategy":"primary","db_duration_s":0.00349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2243gitlab # [ 284.615905] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.538Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"cf057fe552814b5c776aade5","created_at":"2026-10-26T21:35:50.381Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.383Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-cf057fe552814b5c776aade5: start","job_status":"start","queue_duration_s":0.155528,"scheduling_latency_s":0.155547}2244gitlab # [ 284.616723] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.564Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"cf057fe552814b5c776aade5","created_at":"2026-10-26T21:35:50.381Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.383Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-cf057fe552814b5c776aade5: done: 0.025868 sec","job_status":"done","queue_duration_s":0.155528,"scheduling_latency_s":0.155547,"redis_calls":10,"redis_duration_s":0.001667,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000832,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000553,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025868,"completed_at":"2026-10-26T21:35:50.564Z","load_balancing_strategy":"primary","db_duration_s":0.00364,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2245gitlab # [ 284.676673] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.566Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5b612a0b5d2f7d42ad7b6387","created_at":"2026-10-26T21:35:50.383Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.384Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5b612a0b5d2f7d42ad7b6387: start","job_status":"start","queue_duration_s":0.18116,"scheduling_latency_s":0.181184}2246gitlab # [ 284.677848] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.586Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5b612a0b5d2f7d42ad7b6387","created_at":"2026-10-26T21:35:50.383Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.384Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5b612a0b5d2f7d42ad7b6387: done: 0.020053 sec","job_status":"done","queue_duration_s":0.18116,"scheduling_latency_s":0.181184,"redis_calls":7,"redis_duration_s":0.001105,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020053,"completed_at":"2026-10-26T21:35:50.586Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002708,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2247gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses2248gitlab # [ 284.722266] nixbot[2751]: {"ts": "2026-10-26T21:35:50.717Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 2, "sha": "4dc27d6687154d1377fcf37da4b03c73c6fb685e", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}2249gitlab # [ 284.722962] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.587Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"004811a4f75a674491d508e3","created_at":"2026-10-26T21:35:50.385Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.386Z","job_size_bytes":19,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-004811a4f75a674491d508e3: start","job_status":"start","queue_duration_s":0.200544,"scheduling_latency_s":0.20056}2250gitlab # [ 284.723821] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.605Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"004811a4f75a674491d508e3","created_at":"2026-10-26T21:35:50.385Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.386Z","job_size_bytes":19,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-004811a4f75a674491d508e3: done: 0.017899 sec","job_status":"done","queue_duration_s":0.200544,"scheduling_latency_s":0.20056,"redis_calls":8,"redis_duration_s":0.001247,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017899,"completed_at":"2026-10-26T21:35:50.605Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002608,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2251gitlab # [ 284.774031] gitaly[901]: time="2026-10-26T21:35:50.791Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:50.791" grpc.time_ms=0.3 pid=901 span.kind=server system=grpc2252gitlab # [ 284.774800] gitaly[901]: time="2026-10-26T21:35:50.801Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5X288EW7RK00EKXEBH946X6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T21:35:50.787" grpc.time_ms=13.643 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc2253gitlab # [ 284.819864] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 532254gitlab # [ 284.820685] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.606Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"47150d5e39c393a062a9afdc","created_at":"2026-10-26T21:35:50.387Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.388Z","job_size_bytes":66,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-47150d5e39c393a062a9afdc: start","job_status":"start","queue_duration_s":0.217954,"scheduling_latency_s":0.217976}2255gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses, in 0.13 seconds)2256(finished: subtest: eval and build post commit statuses, in 5.84 seconds)2257(finished: run the VM test script, in 337.85 seconds)2258gitlab # [ 284.825514] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.625Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"47150d5e39c393a062a9afdc","created_at":"2026-10-26T21:35:50.387Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.388Z","job_size_bytes":66,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-47150d5e39c393a062a9afdc: done: 0.019113 sec","job_status":"done","queue_duration_s":0.217954,"scheduling_latency_s":0.217976,"redis_calls":7,"redis_duration_s":0.001684,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00031,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019113,"completed_at":"2026-10-26T21:35:50.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003221,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2259gitlab # [ 284.887176] gitaly[901]: time="2026-10-26T21:35:50.815Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3889 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:50.814" grpc.time_ms=1.447 pid=901 span.kind=server system=grpc2260gitlab # [ 284.898246] gitaly[901]: time="2026-10-26T21:35:50.842Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5X287PNGBAFBA8XWA7JF3S4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T21:35:50.842" grpc.time_ms=0.325 pid=901 span.kind=server system=grpc2261gitlab # [ 284.908896] gitlab-workhorse[826]: time="2026-10-26T21:35:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672262gitlab # [ 284.910890] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1462263gitlab # [ 284.912898] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:21:35:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4dc27d6687154d1377fcf37da4b03c73c6fb685e/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 632264test script finished in 337.91s2265cleanup2266kill QemuMachine (pid 46)2267gitlab # [ 284.915677] sidekiq-cluster[2628]: {"severity":"INFO","time":"2026-10-26T21:35:50.626Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"1bc58a81744ce08b532f74fb","created_at":"2026-10-26T21:35:50.389Z","trace_propagation_headers":{"sentry-trace":"2b1ba78dc4204b0b8639a36898ce4953-188aa2cf789545fd","baggage":"sentry-trace_id=2b1ba78dc4204b0b8639a36898ce4953,sentry-release=Unknown"},"correlation_id":"01M5X287PNGBAFBA8XWA7JF3S4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-26T21:35:50.390Z","job_size_bytes":3,"pid":2628,"sidekiq_tid":"m818","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1bc58a81744ce08b532f74fb: start","job_status":"start","queue_duration_s":0.236498,"scheduling_latency_s":0.qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2268gitlab # 22269(finished: cleanup, in 1.60 seconds)2270additionally exposed symbols:2271 gitlab,2272 vlan1,2273 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2274[]2275[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-26T21:34:44.612Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2276[]2277[]2278[]2279[]2280[]2281[]2282[]2283[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '4dc27d6687154d1377fcf37da4b03c73c6fb685e', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-26T21:35:43.609799Z', 'started_at': '2026-10-26T21:35:43.852574Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2284[{'id': 5, 'sha': '4dc27d6687154d1377fcf37da4b03c73c6fb685e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T21:35:43.824Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2285[{'id': 5, 'sha': '4dc27d6687154d1377fcf37da4b03c73c6fb685e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T21:35:43.824Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2286[{'id': 5, 'sha': '4dc27d6687154d1377fcf37da4b03c73c6fb685e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T21:35:43.824Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2287[{'id': 5, 'sha': '4dc27d6687154d1377fcf37da4b03c73c6fb685e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T21:35:43.824Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2288[{'id': 5, 'sha': '4dc27d6687154d1377fcf37da4b03c73c6fb685e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T21:35:43.824Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2289[{'id': 5, 'sha': '4dc27d6687154d1377fcf37da4b03c73c6fb685e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-10-26T21:35:43.824Z', 'started_at': None, 'finished_at': '2026-10-26T21:35:50.100Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '4dc27d6687154d1377fcf37da4b03c73c6fb685e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-26T21:35:50.309Z', 'started_at': None, 'finished_at': '2026-10-26T21:35:50.527Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]