tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.Ch3s9QpTJz', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab # Discarding device blocks: 0/262144 done gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: f19f46e5-8cca-4dad-9cbb-fc71240bf7aa gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 (finished: start all VMs, in 46.30 seconds) gitlab # gitlab: waiting for unit setup-gitlab.service gitlab # Allocating group tables: 0/8 done gitlab: waiting for the VM to finish booting gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pa7kxlmfb7nfr7brfjh5jd9nfm3ydvjs-nixos-system-gitlab-test/init regInfo=/nix/store/fz3bvxh4mxarlaqpsalvk91slssvclvr-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 497937970 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.010 MHz processor gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000879] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002733] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002744] Using GB pages for direct mapping gitlab # [ 0.002852] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002860] ACPI: Early table checksum verification disabled gitlab # [ 0.002863] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002866] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002870] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002877] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002879] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002881] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002882] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002884] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002885] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002886] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002887] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002887] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002887] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002888] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003111] No NUMA configuration found gitlab # [ 0.003112] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003115] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff] gitlab # [ 0.005177] Zone ranges: gitlab # [ 0.005177] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005179] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005180] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005181] Device empty gitlab # [ 0.005182] Movable zone start for each node gitlab # [ 0.005183] Early memory node ranges gitlab # [ 0.005183] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005184] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005185] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005186] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005203] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.005443] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.103345] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.103775] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.103789] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.103820] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.103823] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.103825] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.103826] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.103827] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.103828] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.103830] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.103831] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.103837] TSC deadline timer available gitlab # [ 0.103841] CPU topo: Max. logical packages: 1 gitlab # [ 0.103842] CPU topo: Max. logical dies: 1 gitlab # [ 0.103843] CPU topo: Max. dies per package: 1 gitlab # [ 0.103846] CPU topo: Max. threads per core: 1 gitlab # [ 0.103847] CPU topo: Num. cores per package: 4 gitlab # [ 0.103847] CPU topo: Num. threads per package: 4 gitlab # [ 0.103847] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.103873] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.103893] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.103897] kvm-guest: setup PV sched yield gitlab # [ 0.103913] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.103915] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.103916] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.103918] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.103919] Booting paravirtualized kernel on KVM gitlab # [ 0.103923] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.108370] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.110366] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.110412] kvm-guest: PV spinlocks enabled gitlab # [ 0.110414] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.110417] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pa7kxlmfb7nfr7brfjh5jd9nfm3ydvjs-nixos-system-gitlab-test/init regInfo=/nix/store/fz3bvxh4mxarlaqpsalvk91slssvclvr-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.110514] Unknown kernel command line parameters "regInfo=/nix/store/fz3bvxh4mxarlaqpsalvk91slssvclvr-closure-info/registration", will be passed to user space. gitlab # [ 0.110527] random: crng init done gitlab # [ 0.110527] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.118451] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.122376] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.122446] software IO TLB: area num 4. gitlab # [ 0.189000] Fallback order for Node 0: 0 gitlab # [ 0.189009] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.189011] Policy zone: Normal gitlab # [ 0.191272] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.200497] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.212574] allocated 12582912 bytes of page_ext gitlab # [ 0.222507] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.222510] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.223346] Dynamic Preempt: lazy gitlab # [ 0.223522] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.223523] rcu: RCU event tracing is enabled. gitlab # [ 0.223523] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.223525] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.223525] Rude variant of Tasks RCU enabled. gitlab # [ 0.223525] Tracing variant of Tasks RCU enabled. gitlab # [ 0.223526] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.223527] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.223550] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.223552] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.223553] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.227884] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.228172] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.228180] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.228290] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.231830] Console: colour VGA+ 80x25 gitlab # [ 0.231833] printk: legacy console [tty0] enabled gitlab # [ 0.261966] printk: legacy console [ttyS0] enabled gitlab # [ 0.370165] ACPI: Core revision 20250807 gitlab # [ 0.371081] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.372679] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.373693] x2apic enabled gitlab # [ 0.374472] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.375429] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.376648] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.378173] kvm-guest: setup PV IPIs gitlab # [ 0.379739] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.380792] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns gitlab # [ 0.382579] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010) gitlab # [ 0.384661] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.385692] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.387576] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.388580] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.389577] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.390577] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.391576] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.392576] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.393576] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.395584] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.396577] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.397576] active return thunk: srso_alias_return_thunk gitlab # [ 0.398597] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.399576] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.401395] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.402405] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.403404] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.404576] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.405576] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.406576] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.407576] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.408576] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.409576] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.410576] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.412377] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.441961] Freeing SMP alternatives memory: 44K gitlab # [ 0.442579] pid_max: default: 32768 minimum: 301 gitlab # [ 0.443659] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.444672] landlock: Up and running. gitlab # [ 0.445577] Yama: becoming mindful. gitlab # [ 0.446413] LSM support for eBPF active gitlab # [ 0.447292] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.448714] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.451368] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.452074] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.452581] ... version: 2 gitlab # [ 0.453362] ... bit width: 48 gitlab # [ 0.453578] ... generic counters: 6 gitlab # [ 0.454339] ... generic bitmap: 000000000000003f gitlab # [ 0.454624] ... fixed-purpose counters: 0 gitlab # [ 0.455394] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.456331] ... value mask: 0000ffffffffffff gitlab # [ 0.456579] ... max period: 00007fffffffffff gitlab # [ 0.457538] ... global_ctrl mask: 000000000000003f gitlab # [ 0.458421] signal: max sigframe size: 3376 gitlab # [ 0.459199] rcu: Hierarchical SRCU implementation. gitlab # [ 0.459582] rcu: Max phase no-delay instances is 400. gitlab # [ 0.460633] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.466077] smp: Bringing up secondary CPUs ... gitlab # [ 0.466977] smpboot: x86: Booting SMP configuration: gitlab # [ 0.467586] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.470714] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.472300] smpboot: Total of 4 processors activated (19200.08 BogoMIPS) gitlab # [ 0.472906] Memory: 6011288K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved) gitlab # [ 0.474579] devtmpfs: initialized gitlab # [ 0.475394] x86/mm: Memory block size: 128MB gitlab # [ 0.478644] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.479648] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.480666] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.481843] PM: RTC time: 11:14:44, date: 2026-10-26 gitlab # [ 0.485263] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.486948] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.487635] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.489589] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.490589] audit: initializing netlink subsys (disabled) gitlab # [ 0.491607] audit: type=2000 audit(1793013284.263:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.491847] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.493579] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.494578] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.495561] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.496361] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.497390] cpuidle: using governor menu gitlab # [ 0.499834] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.500890] PCI: Using configuration type 1 for base access gitlab # [ 0.501580] PCI: Using configuration type 1 for extended access gitlab # [ 0.502716] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.505728] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.508588] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.510588] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.513584] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.520149] ACPI: Added _OSI(Module Device) gitlab # [ 0.522587] ACPI: Added _OSI(Processor Device) gitlab # [ 0.524585] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.531484] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.538320] ACPI: Interpreter enabled gitlab # [ 0.539654] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.541586] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.543661] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.547587] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.549976] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.564322] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.566597] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.571719] acpiphp: Slot [3] registered gitlab # [ 0.573637] acpiphp: Slot [4] registered gitlab # [ 0.575657] acpiphp: Slot [5] registered gitlab # [ 0.576636] acpiphp: Slot [6] registered gitlab # [ 0.578633] acpiphp: Slot [7] registered gitlab # [ 0.580633] acpiphp: Slot [8] registered gitlab # [ 0.581653] acpiphp: Slot [9] registered gitlab # [ 0.583639] acpiphp: Slot [10] registered gitlab # [ 0.585636] acpiphp: Slot [11] registered gitlab # [ 0.587646] acpiphp: Slot [12] registered gitlab # [ 0.588654] acpiphp: Slot [13] registered gitlab # [ 0.590634] acpiphp: Slot [14] registered gitlab # [ 0.592631] acpiphp: Slot [15] registered gitlab # [ 0.594663] acpiphp: Slot [16] registered gitlab # [ 0.595634] acpiphp: Slot [17] registered gitlab # [ 0.597631] acpiphp: Slot [18] registered gitlab # [ 0.599630] acpiphp: Slot [19] registered gitlab # [ 0.600647] acpiphp: Slot [20] registered gitlab # [ 0.602621] acpiphp: Slot [21] registered gitlab # [ 0.603621] acpiphp: Slot [22] registered gitlab # [ 0.605621] acpiphp: Slot [23] registered gitlab # [ 0.606669] acpiphp: Slot [24] registered gitlab # [ 0.607631] acpiphp: Slot [25] registered gitlab # [ 0.609620] acpiphp: Slot [26] registered gitlab # [ 0.610619] acpiphp: Slot [27] registered gitlab # [ 0.612639] acpiphp: Slot [28] registered gitlab # [ 0.613622] acpiphp: Slot [29] registered gitlab # [ 0.614620] acpiphp: Slot [30] registered gitlab # [ 0.616637] acpiphp: Slot [31] registered gitlab # [ 0.617605] PCI host bridge to bus 0000:00 gitlab # [ 0.618590] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.620579] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.621578] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.622579] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.624585] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.625617] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.626962] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.629192] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.631030] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.633630] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.634564] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.635532] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.637388] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.638519] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.639571] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.642607] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.644728] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.645844] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.647604] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.648794] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.660661] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.661591] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.662653] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.663900] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.666299] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.670585] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.671477] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.672365] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.684574] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.686962] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.690586] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.691585] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.692599] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.697402] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.707620] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.709600] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.712658] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.718691] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.727602] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.730600] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.732638] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.739679] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.748611] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.750596] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.752627] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.758125] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.765201] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.766282] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.767621] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.770074] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.773611] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.774533] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.776621] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.777594] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.780792] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.783615] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.784601] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.787187] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.791618] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.792500] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.793394] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.795789] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.800696] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.802585] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.803600] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.808238] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.809742] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.810716] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.811732] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.813663] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.815870] iommu: Default domain type: Translated gitlab # [ 0.816581] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.817823] ACPI: bus type USB registered gitlab # [ 0.818628] usbcore: registered new interface driver usbfs gitlab # [ 0.819602] usbcore: registered new interface driver hub gitlab # [ 0.820573] usbcore: registered new device driver usb gitlab # [ 0.823380] NetLabel: Initializing gitlab # [ 0.823440] NetLabel: domain hash size = 128 gitlab # [ 0.824158] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.825630] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.826587] PCI: Using ACPI for IRQ routing gitlab # [ 0.827757] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.828582] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.829580] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.831593] vgaarb: loaded gitlab # [ 0.832488] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.833218] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.838595] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.845167] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.846658] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.849596] pnp: PnP ACPI init gitlab # [ 0.851860] pnp: PnP ACPI: found 6 devices gitlab # [ 0.863431] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.866420] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.868444] NET: Registered PF_INET protocol family gitlab # [ 0.872473] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.898023] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.899601] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.901025] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.904749] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.906142] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.907371] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.909014] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.910529] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.911869] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.912912] NET: Registered PF_XDP protocol family gitlab # [ 0.913789] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 0.914852] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 0.915913] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 0.917087] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.918249] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.919678] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 0.920721] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 0.923129] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 0.925742] PCI: CLS 0 bytes, default 64 gitlab # [ 0.926535] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 0.927011] Trying to unpack rootfs image as initramfs... gitlab # [ 0.927609] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 0.927737] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns gitlab # [ 0.950912] Initialise system trusted keyrings gitlab # [ 0.952271] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 0.963863] Key type asymmetric registered gitlab # [ 0.964618] Asymmetric key parser 'x509' registered gitlab # [ 0.965553] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 0.967224] io scheduler mq-deadline registered gitlab # [ 0.968064] io scheduler kyber registered gitlab # [ 0.973194] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.974706] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 0.977188] Linux agpgart interface v0.103 gitlab # [ 0.978012] ACPI: bus type drm_connector registered gitlab # [ 0.981447] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.982581] usbserial: USB Serial support registered for generic gitlab # [ 0.983590] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 0.983590] Please enable it if your BIOS has the CPPC option. gitlab # [ 0.985933] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 0.987370] drop_monitor: Initializing network drop monitor service gitlab # [ 0.988645] NET: Registered PF_INET6 protocol family gitlab # [ 0.990499] Segment Routing with IPv6 gitlab # [ 0.991186] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.994231] IPI shorthand broadcast: enabled gitlab # [ 0.998654] sched_clock: Marking stable (852010788, 146395733)->(1018434182, -20027661) gitlab # [ 1.000568] registered taskstats version 1 gitlab # [ 1.001582] Loading compiled-in X.509 certificates gitlab # [ 1.011310] Demotion targets for Node 0: null gitlab # [ 1.012746] Key type .fscrypt registered gitlab # [ 1.014528] Key type fscrypt-provisioning registered gitlab # [ 1.016952] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.019271] ima: Allocated hash algorithm: sha1 gitlab # [ 1.021391] ima: No architecture policies found gitlab # [ 1.024010] PM: Magic number: 14:313:227 gitlab # [ 1.027957] RAS: Correctable Errors collector initialized. gitlab # [ 1.039537] clk: Disabling unused clocks gitlab # [ 1.041258] PM: genpd: Disabling unused power domains gitlab # [ 1.243035] Freeing initrd memory: 29392K gitlab # [ 1.250175] Freeing unused decrypted memory: 2028K gitlab # [ 1.256521] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.259203] Write protecting the kernel read-only data: 32768k gitlab # [ 1.264063] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.270191] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.338299] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.339526] Run /init as init process gitlab # [ 1.351251] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.372619] fuse: init (API version 7.45) gitlab # [ 1.381180] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.388984] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.392351] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.427867] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.763643] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.796114] systemd[1]: Detected virtualization kvm. gitlab # [ 1.798353] systemd[1]: Detected architecture x86-64. gitlab # [ 1.800541] systemd[1]: Running in initrd. gitlab # [ 1.803022] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.805940] systemd[1]: Hostname set to . gitlab # [ 1.916770] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.958712] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.966927] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.968151] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.969675] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.970860] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.972019] systemd[1]: Reached target Path Units. gitlab # [ 1.972957] systemd[1]: Reached target Slice Units. gitlab # [ 1.973879] systemd[1]: Reached target Swaps. gitlab # [ 1.974697] systemd[1]: Reached target Timer Units. gitlab # [ 1.975678] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.976961] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.978157] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.979196] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.980260] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.981268] systemd[1]: Reached target Socket Units. gitlab # [ 1.983237] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.985326] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.987381] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 1.990088] systemd[1]: Starting Journal Service... gitlab # [ 1.993478] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.995854] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 2.000473] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.002585] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.013668] systemd-journald[91]: Collecting audit messages is disabled. gitlab # [ 2.015481] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.017219] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.020960] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.024373] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.044732] netfs: FS-Cache loaded gitlab # [ 2.051663] 9pnet: Installing 9P2000 support gitlab # [ 2.053555] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.061566] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.916073] systemd-modules-load[93]: Using 4[ 2.062937] systemd[1]: Started Journal Service. gitlab # probe threads gitlab # [ 1.918298] systemd-modules-load[93]: Inserted module 'virtio_balloon' gitlab # [ 1.919483] systemd-modules-load[93]: Inserted module 'virtio_gpu'[ 2.066071] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # gitlab # [ 1.921882] systemd[1]: modpr[ 2.068127] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # obe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.924157] systemd-modules-load[93]: Inserted module 'dm_mod' gitlab # [ 1.925545] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.926680] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.930526] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.931404] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.932362] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.933396] systemd[1]: Reached target Local File Systems. gitlab # [ 1.934224] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.940042] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.944831] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.946271] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.956519] systemd-udevd[113]: Using default interface naming scheme 'v261'. gitlab # [ 1.967591] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.001813] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.002926] systemd[1]: Reached target System Initialization. gitlab # [ 2.004632] systemd[1]: Reached target Basic System. gitlab # [ 2.220331] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.221269] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.223040] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.227220] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.228379] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.229635] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.230696] usb usb1: Product: UHCI Host Controller gitlab # [ 2.231411] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.232164] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.236227] SCSI subsystem initialized gitlab # [ 2.239382] hub 1-0:1.0: USB hub found gitlab # [ 2.240124] hub 1-0:1.0: 2 ports detected gitlab # [ 2.244721] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.260772] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.273010] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.275198] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.276040] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.281013] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.292102] scsi host0: ata_piix gitlab # [ 2.294758] virtio_blk virtio5: [vdb] 11953328 512-byte logical blocks (6.12 GB/5.70 GiB) gitlab # [ 2.312470] scsi host1: ata_piix gitlab # [ 2.313193] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.314353] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.173031] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.174695] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.177436] (udev-worker)[140]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.179723] (udev-worker)[140]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.194396] systemd-vconsole-setup[150]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.196829] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.462627] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.479045] ata2: found unknown device (class 0) gitlab # [ 2.481778] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.486069] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.525089] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.391548] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.398490] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.400680] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.402567] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.573619] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.441878] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.447864] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.614057] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.633788] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.636754] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.639355] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.640977] usb 1-1: Manufacturer: QEMU gitlab # [ 2.642467] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.673615] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.684949] usbcore: registered new interface driver usbhid gitlab # [ 2.686627] usbhid: USB HID core driver gitlab # [ 2.694253] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.696832] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.859282] systemd[1]: Mounting /sysroot... gitlab # [ 3.158668] EXT4-fs (vda): mounted filesystem f19f46e5-8cca-4dad-9cbb-fc71240bf7aa r/w with ordered data mode. Quota mode: none. gitlab # [ 3.018595] systemd[1]: Mounted /sysroot. gitlab # [ 3.020434] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.022507] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.024425] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.027064] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.028789] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.035452] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.039446] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.193273] 9p: Installing v9fs 9p2000 file system support gitlab # [ 3.047486] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.054496] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.057327] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.059210] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.060936] systemd[1]: Starting rw-sysroot-n[ 3.207374] erofs (device vdb): mounted with root inode @ nid 128. gitlab # ix-store.service... gitlab # [ 3.065950] systemd-sysroot-fstab-check[176]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.068851] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.070251] systemd[1]: Reload requested from client PID 176 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.073390] systemd[1]: Reloading... gitlab # [ 3.127119] systemd[1]: Reloading finished in 59 ms. gitlab # [ 3.150247] systemd-sysroot-fstab-check[176]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.153409] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.156094] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.158519] systemd-sysroot-fstab-check[176]: Requesting swap.target/start/replace... gitlab # [ 3.161255] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.163481] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.165911] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.168370] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.179076] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.181763] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.859601] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.908346] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.910257] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.912246] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.914166] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.937848] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.942246] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.954857] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.956647] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.958624] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.988551] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.990625] systemd[1]: Stopped target Basic System. gitlab # [ 3.992396] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.994271] systemd[1]: Stopped target Path Units. gitlab # [ 3.996330] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.998929] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.004093] systemd[1]: Stopped target Slice Units. gitlab # [ 4.006515] systemd[1]: Stopped target Socket Units. gitlab # [ 4.008858] systemd[1]: Stopped target System Initialization. gitlab # [ 4.011341] systemd[1]: Stopped target Swaps. gitlab # [ 4.013948] systemd[1]: Stopped target Timer Units. gitlab # [ 4.016291] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.018697] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.020898] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.023431] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.025161] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.028204] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.029906] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.031748] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.033272] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.035286] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.036811] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.039164] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.041252] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.043226] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.044924] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.046121] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.047204] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.048304] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.049197] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.050354] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.051492] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.052303] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.053372] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.054362] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.055448] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.056361] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.057385] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.058659] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.059679] systemd[1]: Closed udev Control Socket. gitlab # [ 4.060409] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.061177] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.062237] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.063114] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.064238] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.065197] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.066147] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.076848] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.077964] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.078749] systemd[1]: Reached target Switch Root. gitlab # [ 4.079489] systemd[1]: Starting NixOS Activation... gitlab # [ 4.176880] initrd-nixos-activation-start[224]: booting system configuration /nix/store/pa7kxlmfb7nfr7brfjh5jd9nfm3ydvjs-nixos-system-gitlab-test gitlab # [ 4.220124] initrd-nixos-activation-start[224]: running activation script... gitlab # [ 4.455993] initrd-nixos-activation-start[247]: setting up /etc... gitlab # [ 4.568362] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.571143] systemd[1]: Finished NixOS Activation. gitlab # [ 4.573437] systemd[1]: Starting Switch Root... gitlab # [ 4.603957] systemd[1]: Switching root. gitlab # [ 4.823453] systemd-journald[91]: Received SIGTERM from PID 1 (systemd). gitlab # [ 4.936712] NET: Registered PF_VSOCK protocol family gitlab # [ 5.324551] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.334960] systemd[1]: Detected virtualization kvm. gitlab # [ 5.336912] systemd[1]: Detected architecture x86-64. gitlab # [ 5.339128] systemd[1]: Detected first boot. gitlab # [ 5.341795] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.481930] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.580630] systemd[1]: Applying preset policy. gitlab # [ 5.722133] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 5.839769] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 5.841173] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 5.843788] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 5.845962] systemd[1]: Created slice Slice /system/getty. gitlab # [ 5.847501] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 5.848950] systemd[1]: Created slice User and Session Slice. gitlab # [ 5.849942] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.851255] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 5.852431] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 5.853176] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 5.853988] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 5.854883] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 5.855731] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 5.856566] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 5.857474] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 5.858437] systemd[1]: Reached target Path Units. gitlab # [ 5.859205] systemd[1]: Reached target Remote File Systems. gitlab # [ 5.860124] systemd[1]: Reached target Slice Units. gitlab # [ 5.860924] systemd[1]: Reached target Swaps. gitlab # [ 5.862353] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 5.864427] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 5.865852] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 5.867520] systemd[1]: Listening on Factory Reset Management. gitlab # [ 5.868498] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 5.870880] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 5.872535] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 5.874512] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 5.875754] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 5.876958] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.878405] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 5.881285] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 5.882441] systemd[1]: Listening on udev Control Socket. gitlab # [ 5.883478] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 5.886739] systemd[1]: Mounting Huge Pages File System... gitlab # [ 5.888983] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 5.891175] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 5.894479] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 5.903728] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 5.904926] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 5.909677] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 5.912266] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 5.916288] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.922512] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.933040] systemd[1]: Mounting FUSE Control File System... gitlab # [ 5.933978] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.938294] systemd[1]: Starting Journal Service... gitlab # [ 5.951700] systemd[1]: Starting Load Kernel Modules... gitlab # [ 5.954047] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 5.957031] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 5.958296] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.962474] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 5.965363] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 5.967560] systemd[1]: Mounted Huge Pages File System. gitlab # [ 5.972348] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 5.973723] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 5.974710] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 5.975493] loop: module loaded gitlab # [ 5.976071] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 5.977503] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 5.979026] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 5.979623] systemd-journald[317]: Collecting audit messages is enabled. gitlab # [ 5.980199] systemd[1]: Mounted FUSE Control File System. gitlab # [ 5.982609] systemd[1]: Finished Load Kernel Modules. gitlab # [ 5.984912] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 5.987315] EXT4-fs (vda): re-mounted f19f46e5-8cca-4dad-9cbb-fc71240bf7aa. gitlab # [ 5.989479] systemd[1]: Starting Firewall... gitlab # [ 5.995489] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 5.851819] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 5.853413] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 5.856362] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 5.857521] systemd-modules-load[319]: Using 3 probe threads gitlab # [ 6.003907] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 5.858866] systemd-modules-load[319]: Inserted module 'loop' gitlab # [ 5.860954] systemd-modules-load[319]: Inserted module 'tls' gitlab # [ 6.009184] systemd[1]: Started Journal Service. gitlab # [ 5.865045] systemd-oomd[320]: No swap; memory pressure usage will be degraded gitlab # [ 5.869054] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 5.870599] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 5.871590] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 5.877282] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 5.881039] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 5.882387] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 5.884694] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 5.886167] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 5.890167] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 5.904111] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 5.905288] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.057783] systemd-journald[317]: Received client request to flush runtime journal. gitlab # [ 5.956086] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 5.957994] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 5.959547] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 5.961064] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 5.962266] systemd[1]: Reached target First Boot Complete. gitlab # [ 5.964134] systemd-udevd[360]: Using default interface naming scheme 'v261'. gitlab # [ 5.965420] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 5.967978] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 5.983841] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.049520] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.067831] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.086229] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.088774] (udev-worker)[422]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.092141] (udev-worker)[422]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.098563] (udev-worker)[428]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.108598] systemd[1]: Finished Firewall. gitlab # [ 6.112557] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.113794] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.115779] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.118441] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.120146] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.121521] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.298307] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.305959] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.311356] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.311710] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.312962] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 6.324931] Console: switching to colour dummy device 80x25 gitlab # [ 6.325500] ACPI: button: Power Button [PWRF] gitlab # [ 6.326447] FDC 0 is a S82078B gitlab # [ 6.327609] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.327700] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.327703] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.331465] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.331580] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.332462] rtc_cmos 00:05: setting system clock to 2026-10-26T11:14:49 UTC (1793013289) gitlab # [ 6.334487] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.335254] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.338312] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.344288] systemd-journald[317]: Time jumped backwards, rotating. gitlab # [ 6.347507] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.347581] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.348004] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.351681] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.383958] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.388935] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 gitlab # [ 6.392205] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6 gitlab # [ 6.267632] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.326556] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.327910] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.336827] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.346850] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.347990] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.355376] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.505338] ppdev: user-space parallel port driver gitlab # [ 6.516637] kvm_amd: TSC scaling supported gitlab # [ 6.517122] kvm_amd: Nested Virtualization enabled gitlab # [ 6.517700] kvm_amd: Nested Paging enabled gitlab # [ 6.518178] kvm_amd: LBR virtualization supported gitlab # [ 6.518745] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.519275] kvm_amd: Virtual GIF supported gitlab # [ 6.519796] kvm_amd: Virtual NMI enabled gitlab # [ 6.385968] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.389249] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.553545] EDAC MC: Ver: 3.0.0 gitlab # [ 6.698737] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.727398] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.730358] systemd[1]: Reached target Local File Systems. gitlab # [ 6.733790] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.738521] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.742931] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.745085] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.752750] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.760113] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.788178] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.793349] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.797428] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.806305] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.810269] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 6.827415] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 6.843876] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 6.845659] systemd[1]: Starting Update is Completed... gitlab # [ 6.859590] systemd[1]: Finished Update is Completed. gitlab # [ 6.906157] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 6.908389] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.146594] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.149200] systemd[1]: Reached target System Initialization. gitlab # [ 7.151500] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.154341] systemd[1]: Started logrotate.timer. gitlab # [ 7.156339] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.158961] systemd[1]: Reached target Timer Units. gitlab # [ 7.161132] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.163642] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.165914] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.168309] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.171460] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.173817] systemd[1]: Reached target Socket Units. gitlab # [ 7.176121] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.228152] dbus-broker-launch[576]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.231912] dbus-broker-launch[576]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.234797] dbus-broker-launch[576]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.240271] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.261263] dbus-broker-launch[576]: Ready gitlab # [ 7.265465] systemd[1]: Reached target Basic System. gitlab # [ 7.268469] systemd[1]: Started backdoor.service. gitlab # [ 7.271692] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.275117] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.281465] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.291243] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.296340] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.308138] systemd[1]: Started Reset console on configuration changes. gitlab # connecting to host... gitlab # [ 7.311047] logrotate[581]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 7.312213] logrotate[581]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # [ 7.314928] logrotate[581]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.318462] systemd[1]: Starting resolvconf update... gitlab # [ 7.319118] logrotate[581]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.319986] logrotate[581]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.321571] logrotate[581]: Allocating hash table for state file, size 64 entries gitlab # [ 7.322842] logrotate[581]: Handling 4 logs gitlab # [ 7.323833] logrotate[581]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.324788] logrotate[581]: considering log /var/log/btmp gitlab # [ 7.325754] logrotate[581]: Creating new state gitlab # [ 7.326668] logrotate[581]: Now: 2026-10-26 11:14 gitlab # [ 7.327963] logrotate[581]: Last rotated at 2026-10-26 11:00 gitlab # [ 7.329171] logrotate[581]: log does not need rotating (log has already been rotated) gitlab # [ 7.329565] logrotate[581]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.330602] logrotate[581]: considering log /var/log/wtmp gitlab # [ 7.331117] logrotate[581]: Creating new state gitlab # [ 7.331581] logrotate[581]: Now: 2026-10-26 11:14 gitlab # [ 7.332095] logrotate[581]: Last rotated at 2026-10-26 11:00 gitlab # [ 7.332571] logrotate[581]: log does not need rotating (log has already been rotated) gitlab # [ 7.333073] logrotate[581]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.333564] logrotate[581]: switching euid from 0 to 165 and egid from 0 to 165 (pid 581) gitlab # [ 7.334236] logrotate[581]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.334852] logrotate[581]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.335530] logrotate[581]: Creating new state gitlab # [ 7.336464] logrotate[581]: switching euid from 165 to 0 and egid from 165 to 0 (pid 581) gitlab # [ 7.336982] logrotate[581]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.337290] logrotate[581]: switching euid from 0 to 60 and egid from 0 to 60 (pid 581) gitlab # [ 7.337796] logrotate[581]: considering log /var/log/nginx/*.log gitlab # [ 7.338431] logrotate[581]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.338967] logrotate[581]: Creating new state gitlab # [ 7.339953] logrotate[581]: not running postrotate script, since no logs were rotated gitlab # [ 7.340626] logrotate[581]: switching euid from 60 to 0 and egid from 60 to 0 (pid 581) gitlab # [ 7.342671] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.344176] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.353273] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab: connected to guest root shell gitlab # [ 7.374519] nsncd[582]: Oct 26 11:14:50.687 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab: (connecting took 8.02 seconds) gitlab # [ 7.374732] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab: (finished: waiting for the VM to finish booting, in 8.02 seconds) gitlab # [ 7.375520] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.376862] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.378391] systemd[1]: Starting User Login Management... gitlab # [ 7.396048] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.396255] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.398282] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.399428] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.400346] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.402264] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.403270] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.404854] systemd[1]: nscd.service: Consumed 17ms CPU time over 113ms wall clock time, 7.1M memory peak, 5.5M read from disk. gitlab # [ 7.408400] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.423307] systemd-logind[640]: New seat seat0. gitlab # [ 7.426843] systemd-logind[640]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.427226] systemd-logind[640]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard) gitlab # [ 7.427770] systemd-logind[640]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.428606] nsncd[670]: Oct 26 11:14:50.741 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.430090] systemd[1]: Started User Login Management. gitlab # [ 7.431043] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.435295] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.436763] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.437322] systemd[1]: Starting linger-users.service... gitlab # [ 7.439990] systemd[1]: Finished resolvconf update. gitlab # [ 7.441209] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.449632] systemd[1]: Starting DHCP Client... gitlab # [ 7.451505] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.455925] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.458141] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.464274] systemd[1]: Finished linger-users.service. gitlab # [ 7.485114] network-addresses-eth1-start[698]: adding address 192.168.1.1/24... done gitlab # [ 7.489042] network-addresses-eth1-start[698]: adding address 2001:db8:1::1/64... done gitlab # [ 7.493721] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.519344] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.520293] systemd[1]: Reached target Network. gitlab # [ 7.522064] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.523992] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.528547] systemd[1]: Starting PostgreSQL Server... gitlab # [ 7.531482] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 7.531974] dhcpcd[714]: dhcpcd-10.3.2 starting gitlab # [ 7.532718] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.535593] dhcpcd[769]: dev: loaded udev gitlab # [ 7.688178] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.688950] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 7.547574] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.551915] systemd[1]: Started Getty on tty1. gitlab # [ 7.552243] systemd[1]: Reached target Login Prompts. gitlab # [ 7.554614] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.769500] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 7.773335] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 7.774113] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 7.775460] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 7.776401] cfg80211: failed to load regulatory.db gitlab # [ 7.647152] nginx-pre-start[789]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.647492] nginx-pre-start[789]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.650274] systemd[1]: Started Nginx Web Server. gitlab # [ 7.809001] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.663662] dhcpcd[769]: eth0: waiting for carrier gitlab # [ 7.664110] dhcpcd[769]: eth0: carrier acquired gitlab # [ 7.669876] dhcpcd[769]: DUID 00:01:00:01:32:71:f2:aa:52:54:00:12:34:56 gitlab # [ 7.670419] dhcpcd[769]: eth0: IAID 00:12:34:56 gitlab # [ 7.671357] dhcpcd[769]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.674306] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.674680] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.675163] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started gitlab # [ 7.675624] redis-server[788]: Configuration loaded gitlab # [ 7.676135] redis[788]: monotonic clock: POSIX clock_gettime gitlab # [ 7.676746] redis[788]: Running mode=standalone, port=0. gitlab # [ 7.677900] redis[788]: Server initialized gitlab # [ 7.678651] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.679223] redis[788]: Ready to accept connections unix gitlab # [ 7.679677] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.703896] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.704364] postgresql-pre-start[793]: This user must also own the server process. gitlab # [ 7.708110] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.708386] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.708831] postgresql-pre-start[793]: The default text search configuration will be set to "english". gitlab # [ 7.709484] postgresql-pre-start[793]: Data page checksums are enabled. gitlab # [ 7.709978] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.711128] postgresql-pre-start[793]: creating subdirectories ... ok gitlab # [ 7.711606] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.744779] postgresql-pre-start[793]: selecting default "max_connections" ... 100 gitlab # [ 7.778986] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.085881] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.162870] postgresql-pre-start[793]: selecting default time zone ... UTC gitlab # [ 8.166180] postgresql-pre-start[793]: creating configuration files ... ok gitlab # [ 8.322708] postgresql-pre-start[793]: running bootstrap script ... ok gitlab # [ 8.360914] gitlab-workhorse[824]: time="2026-10-26T11:14:51Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.361359] gitlab-workhorse[824]: time="2026-10-26T11:14:51Z" level=info msg="Using redis/go-redis" gitlab # [ 8.361861] gitlab-workhorse[824]: time="2026-10-26T11:14:51Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.727591] dhcpcd[769]: eth0: soliciting a DHCP lease gitlab # [ 8.886657] NET: Registered PF_PACKET protocol family gitlab # [ 8.747498] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok gitlab # [ 8.753955] dhcpcd[769]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 8.762525] dhcpcd[769]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.970614] postgresql-pre-start[793]: syncing data to disk ... ok gitlab # [ 8.970984] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 8.972972] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 8.974997] postgresql-pre-start[793]: Success. You can now start the database server using: gitlab # [ 8.976222] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 9.104845] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 9.106742] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 9.107326] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 9.113112] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 9.127100] postgres[859]: [859] LOG: database system was shut down at 2026-10-26 11:14:52 GMT gitlab # [ 9.135101] postgres[850]: [850] LOG: database system is ready to accept connections gitlab # [ 9.140279] systemd[1]: Started PostgreSQL Server. gitlab # [ 9.143912] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 9.191909] dhcpcd[769]: eth0: soliciting an IPv6 router gitlab # [ 9.192433] dhcpcd[769]: eth0: Router Advertisement from fe80::2 gitlab # [ 9.193104] dhcpcd[769]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 9.193948] dhcpcd[769]: eth0: adding route to fec0::/64 gitlab # [ 9.195220] dhcpcd[769]: eth0: adding default route via fe80::2 gitlab # [ 9.288483] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[866]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 9.291927] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[866]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 9.310768] postgresql-setup-start[875]: CREATE DATABASE gitlab # [ 9.338518] postgresql-setup-start[891]: CREATE ROLE gitlab # [ 9.343969] systemd[1]: Finished gitlab-config.service. gitlab # [ 9.346199] systemd[1]: Started gitaly.service. gitlab # [ 9.349694] postgresql-setup-start[893]: ALTER DATABASE gitlab # [ 9.377209] postgresql-setup-start[901]: CREATE ROLE gitlab # [ 9.379788] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 9.381566] systemd[1]: Reached target PostgreSQL. gitlab # [ 9.384457] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 9.387712] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.479087] gitlab-postgresql-start[911]: CREATE DATABASE gitlab # [ 9.516994] gitlab-postgresql-start[925]: CREATE EXTENSION gitlab # [ 9.589643] gitlab-postgresql-start[932]: CREATE EXTENSION gitlab # [ 9.591651] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 9.801274] gitaly[896]: time="2026-10-26T11:14:53.114Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=896 gitlab # [ 9.801502] gitaly[896]: time="2026-10-26T11:14:53.115Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=896 gitlab # [ 9.802835] gitaly[896]: time="2026-10-26T11:14:53.115Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=896 gitlab # [ 9.804568] gitaly[896]: time="2026-10-26T11:14:53.115Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=896 gitlab # [ 9.805307] gitaly[896]: time="2026-10-26T11:14:53.115Z" level=info msg="Starting Gitaly" pid=896 version= gitlab # [ 9.959097] gitaly[896]: time="2026-10-26T11:14:53.272Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=156 pid=896 gitlab # [ 9.959528] gitaly[896]: time="2026-10-26T11:14:53.272Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=896 gitlab # [ 9.960031] gitaly[896]: time="2026-10-26T11:14:53.273Z" level=info msg="finished initializing command factory" duration_ms=1 pid=896 gitlab # [ 9.960655] gitaly[896]: time="2026-10-26T11:14:53.274Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-896/git-exec-2914997813.d/git pid=896 gitlab # [ 9.966183] gitaly[896]: time="2026-10-26T11:14:53.280Z" level=info msg="finished detecting git version" duration_ms=5 pid=896 gitlab # [ 9.967244] gitaly[896]: time="2026-10-26T11:14:53.280Z" level=info msg="using Git version" pid=896 version=2.53.g gitlab # [ 9.967781] gitaly[896]: time="2026-10-26T11:14:53.281Z" level=info msg="clearing disk cache object folder" pid=896 storage=default gitlab # [ 9.968409] gitaly[896]: time="2026-10-26T11:14:53.281Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2715283727 pid=896 storage=default gitlab # [ 9.969507] gitaly[896]: time="2026-10-26T11:14:53.281Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2715283727 pid=896 storage=default gitlab # [ 9.969989] gitaly[896]: time="2026-10-26T11:14:53.281Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=896 gitlab # [ 9.970609] gitaly[896]: time="2026-10-26T11:14:53.281Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=896 gitlab # [ 9.971176] gitaly[896]: time="2026-10-26T11:14:53.281Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2715283727 clear_duration_ms=0 pid=896 storage=default gitlab # [ 10.005229] gitaly[896]: time="2026-10-26T11:14:53.319Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=896 gitlab # [ 10.008044] gitaly[896]: time="2026-10-26T11:14:53.319Z" level=info msg="counting repositories" pid=896 gitlab # [ 10.008307] gitaly[896]: time="2026-10-26T11:14:53.321Z" level=info msg="starting to count repositories" pid=896 storage_path=/var/gitlab/state/repositories gitlab # [ 10.008838] gitaly[896]: time="2026-10-26T11:14:53.321Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=896 storage_path=/var/gitlab/state/repositories gitlab # [ 10.009461] gitaly[896]: time="2026-10-26T11:14:53.321Z" level=info msg="completed counting all repositories" counting_duration=0 pid=896 gitlab # [ 10.009966] gitaly[896]: time="2026-10-26T11:14:53.319Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=896 schema=unix gitlab # [ 10.010613] gitaly[896]: time="2026-10-26T11:14:53.321Z" level=info msg="listening at address" address=/run/gitaly/gitaly-896/sock.d/intern pid=896 schema=unix gitlab # [ 10.011338] gitaly[896]: time="2026-10-26T11:14:53.319Z" level=info msg="finished tempdir cleaner walk" pid=896 storage=default time_ms=0 gitlab # [ 10.020127] gitaly[896]: time="2026-10-26T11:14:53.333Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=896 gitlab # [ 10.020587] gitaly[896]: time="2026-10-26T11:14:53.333Z" level=info msg="Started Gitaly" duration_ms=218 pid=896 gitlab # [ 10.021124] gitaly[896]: time="2026-10-26T11:14:53.333Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=896 gitlab # [ 10.022182] gitaly[896]: time="2026-10-26T11:14:53.336Z" level=info msg="maintenance: daily scheduled" pid=896 scheduled="2026-10-26 12:00:00 +0000 UTC" gitlab # [ 10.913044] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[906]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.913774] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[906]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.946093] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[906]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.907866] gitaly[896]: time="2026-10-26T11:14:55.220Z" level=info msg="License database preloaded" duration_ms=2076 pid=896 gitlab # [ 13.969889] dhcpcd[769]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.970782] dhcpcd[769]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.971579] dhcpcd[769]: eth0: adding default route via 10.0.2.2 gitlab # [ 14.090419] systemd[1]: Started DHCP Client. gitlab # [ 14.091145] systemd[1]: Reached target Network is Online. gitlab # [ 39.759942] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[906]: W, [2026-10-26T11:15:23.072984 #906] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 41.720432] postgres[1299]: [1299] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 41.720993] postgres[1299]: [1299] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 41.721822] postgres[1299]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 41.723061] postgres[1299]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 41.723972] postgres[1299]: attidentity AS identity, gitlab # [ 41.724825] postgres[1299]: attgenerated as attgenerated gitlab # [ 41.725834] postgres[1299]: FROM pg_attribute a gitlab # [ 41.726914] postgres[1299]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 41.727561] postgres[1299]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 41.728531] postgres[1299]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 41.729463] postgres[1299]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 41.730508] postgres[1299]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 41.731518] postgres[1299]: ORDER BY a.attnum gitlab # [ 41.732576] postgres[1299]: gitlab # [ 44.957324] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1332]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 44.958180] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1332]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 48.412651] gitlab-workhorse[824]: time="2026-10-26T11:15:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 58.422453] gitlab-workhorse[824]: time="2026-10-26T11:15:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 59.660256] postgres[1398]: [1398] ERROR: relation "table_without_models" does not exist gitlab # [ 59.660682] postgres[1398]: [1398] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.423961] gitlab-workhorse[824]: time="2026-10-26T11:15:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 71.604511] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 71.611230] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 71.615500] systemd[1]: Starting gitlab.service... gitlab # [ 71.974721] bundle[1574]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 71.979435] bundle[1574]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 71.983957] bundle[1574]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 74.605893] sidekiq-cluster[1573]: {"severity":"INFO","time":"2026-10-26T11:15:57.902Z","message":"Starting cluster with 1 processes"} gitlab # [ 74.699131] bundle[1574]: {"timestamp":"2026-10-26T11:15:57.993Z","pid":1574,"message":"* Enabling systemd notification integration"} gitlab # [ 74.702402] bundle[1574]: {"timestamp":"2026-10-26T11:15:58.012Z","pid":1574,"message":"Puma starting in cluster mode..."} gitlab # [ 74.705260] bundle[1574]: {"timestamp":"2026-10-26T11:15:58.012Z","pid":1574,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 74.708407] bundle[1574]: {"timestamp":"2026-10-26T11:15:58.012Z","pid":1574,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 74.712049] bundle[1574]: {"timestamp":"2026-10-26T11:15:58.012Z","pid":1574,"message":"* Min threads: 0"} gitlab # [ 74.714729] bundle[1574]: {"timestamp":"2026-10-26T11:15:58.012Z","pid":1574,"message":"* Max threads: 4"} gitlab # [ 74.717255] bundle[1574]: {"timestamp":"2026-10-26T11:15:58.012Z","pid":1574,"message":"* Environment: production"} gitlab # [ 74.719772] bundle[1574]: {"timestamp":"2026-10-26T11:15:58.012Z","pid":1574,"message":"* Master PID: 1574"} gitlab # [ 74.722235] bundle[1574]: {"timestamp":"2026-10-26T11:15:58.012Z","pid":1574,"message":"* Workers: 2"} gitlab # [ 74.724544] bundle[1574]: {"timestamp":"2026-10-26T11:15:58.012Z","pid":1574,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 74.727760] bundle[1574]: {"timestamp":"2026-10-26T11:15:58.012Z","pid":1574,"message":"* Preloading application"} gitlab # [ 78.433772] gitlab-workhorse[824]: time="2026-10-26T11:16:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 88.443802] gitlab-workhorse[824]: time="2026-10-26T11:16:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 96.537983] bundle[1574]: W, [2026-10-26T11:16:19.851020 #1574] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 98.444760] gitlab-workhorse[824]: time="2026-10-26T11:16:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.730686] sidekiq-cluster[1604]: 2026-10-26T11:16:22.043Z pid=1604 tid=wks INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1604, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>448352256} gitlab # [ 98.893963] sidekiq-cluster[1604]: W, [2026-10-26T11:16:22.207571 #1604] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 98.934289] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:22.247Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 100.771556] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.084Z","message":"GitLab reliable fetch activated!"} gitlab # [ 100.772076] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.084Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 100.791658] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.105Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 100.794100] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.107Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 100.796453] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.110Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 100.798689] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.112Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 100.800943] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.114Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 100.803153] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.116Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 100.805062] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.118Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 100.806827] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.120Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 100.808578] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.122Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 100.810458] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.124Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 100.812252] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.126Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 100.814498] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.128Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 100.816351] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.130Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 100.818431] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.132Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 100.820521] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.134Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 100.822645] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.136Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 100.825092] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.138Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 100.827610] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.141Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 100.829847] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.143Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 100.832612] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.146Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 100.834882] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.148Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 100.836733] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.150Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 100.838643] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.152Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 100.840818] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.154Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 100.842978] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.156Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 100.845302] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.159Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 100.847567] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.161Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 100.849793] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.163Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 100.852107] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.165Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 100.854469] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.168Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 100.856639] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.170Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 100.859092] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.172Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 100.861438] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.175Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 100.863800] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.177Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 100.865554] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.179Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 100.867582] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.181Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 100.869726] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.183Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 100.871858] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.185Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 100.873584] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.187Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 100.875502] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.189Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 100.877365] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.191Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 100.879312] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.193Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 100.881344] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.195Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 100.882926] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.196Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 100.885228] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.198Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 100.887159] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.200Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 100.888909] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.202Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 100.890712] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.204Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 100.892887] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.206Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 100.916944] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.229Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 100.919273] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.233Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 100.921635] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.235Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 100.931615] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.245Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 100.934643] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.248Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 100.937873] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.251Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 100.941140] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.254Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 100.943422] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.256Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 100.948366] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.262Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 100.950771] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.264Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 100.953682] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.267Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 100.956315] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.270Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 100.959096] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.272Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 100.962066] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.275Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 100.965257] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.279Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 100.968334] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.282Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 100.971102] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.284Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 100.973940] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.287Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 100.976307] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.290Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 100.981048] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.294Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 100.987753] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.301Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 100.992617] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.306Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 100.998266] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.312Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 101.003155] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.316Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 101.005778] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.319Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 101.008748] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.322Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 101.011098] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.324Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 101.014075] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.327Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 101.016422] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.330Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 101.018909] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.332Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 101.021414] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.335Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 101.023471] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.337Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 101.025709] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.339Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 101.028613] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.342Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 101.031139] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.344Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 101.033518] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.347Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 101.035926] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.349Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 101.038661] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.352Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 101.040918] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.354Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 101.043522] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.357Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 101.045671] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.359Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 101.048062] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.361Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 101.049742] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.363Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 101.051937] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.365Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 101.053947] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.367Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 101.056591] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.370Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 101.058560] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.372Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 101.060382] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.374Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 101.062566] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.376Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 101.070967] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.384Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 101.072927] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.386Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 101.074637] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.388Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 101.077522] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.391Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 101.079626] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.393Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 101.081578] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.395Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 101.083915] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.397Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 101.085530] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.399Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 101.087522] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.401Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 101.090411] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.404Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 101.092298] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:24.405Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 104.162536] sidekiq-cluster[1604]: InitializerConnections Query: SET client_min_messages TO 'warning' gitlab # [ 104.163138] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 104.164699] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 104.166243] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 104.167321] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 104.168463] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 104.169923] sidekiq-cluster[1604]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 104.186381] sidekiq-cluster[1604]: InitializerConnections Query: SET standard_conforming_strings = on gitlab # [ 104.187063] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 104.187740] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 104.189137] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 104.190065] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 104.190909] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 104.192143] sidekiq-cluster[1604]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 104.210888] sidekiq-cluster[1604]: InitializerConnections Query: SET intervalstyle = iso_8601 gitlab # [ 104.211132] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 104.211905] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 104.213377] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 104.214232] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 104.215126] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 104.215971] sidekiq-cluster[1604]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 104.229837] sidekiq-cluster[1604]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname gitlab # [ 104.229953] sidekiq-cluster[1604]: FROM pg_type as t gitlab # [ 104.230615] sidekiq-cluster[1604]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz') gitlab # [ 104.231080] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 104.231551] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 104.232076] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 104.232549] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 104.233092] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 104.233579] sidekiq-cluster[1604]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 104.243427] sidekiq-cluster[1604]: InitializerConnections Query: SET SESSION timezone TO 'UTC' gitlab # [ 104.243917] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 104.244655] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 104.245474] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 104.246431] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 104.247107] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 104.247735] sidekiq-cluster[1604]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 104.254074] sidekiq-cluster[1604]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics' gitlab # [ 104.254582] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 104.255229] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 104.255907] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 104.256674] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 104.257484] sidekiq-cluster[1604]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 104.258142] sidekiq-cluster[1604]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 108.453691] gitlab-workhorse[824]: time="2026-10-26T11:16:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 118.454962] gitlab-workhorse[824]: time="2026-10-26T11:16:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 124.777454] postgres[2033]: [2033] ERROR: relation "table_without_models" does not exist gitlab # [ 124.778300] postgres[2033]: [2033] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 127.073509] postgres[2053]: [2053] ERROR: relation "table_without_models" does not exist gitlab # [ 127.073985] postgres[2053]: [2053] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 127.376730] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:50.690Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 127.381625] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:50.695Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 127.382106] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:50.695Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 127.383756] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:50.695Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 127.385511] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:50.698Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 128.457130] gitlab-workhorse[824]: time="2026-10-26T11:16:51Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 128.664138] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:51.977Z","message":"Cleaning working queues"} gitlab # [ 128.668491] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:51.982Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"0930d74801229f1c7a986e9f","created_at":"2026-10-26T11:15:54.557Z","trace_propagation_headers":{"sentry-trace":"0d06a373ce804bd0b2255073698916fe-3dac887acf3b44da","baggage":"sentry-trace_id=0d06a373ce804bd0b2255073698916fe,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2336992c749791d7bf5592308b4b71b9","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T11:15:54.564Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-0930d74801229f1c7a986e9f: start","job_status":"start","queue_duration_s":57.41745,"scheduling_latency_s":57.417492} gitlab # [ 128.847698] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:16:52.161Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"0930d74801229f1c7a986e9f","created_at":"2026-10-26T11:15:54.557Z","trace_propagation_headers":{"sentry-trace":"0d06a373ce804bd0b2255073698916fe-3dac887acf3b44da","baggage":"sentry-trace_id=0d06a373ce804bd0b2255073698916fe,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2336992c749791d7bf5592308b4b71b9","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T11:15:54.564Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-0930d74801229f1c7a986e9f: done: 0.179159 sec","job_status":"done","queue_duration_s":57.41745,"scheduling_latency_s":57.417492,"redis_calls":31,"redis_duration_s":0.0067469999999999995,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.00403,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00181,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09100598,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.179159,"completed_at":"2026-10-26T11:16:52.161Z","load_balancing_strategy":"primary","db_duration_s":0.065307,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 129.835605] bundle[1574]: {"timestamp":"2026-10-26T11:16:53.148Z","pid":1574,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 129.839998] bundle[1574]: {"timestamp":"2026-10-26T11:16:53.148Z","pid":1574,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 129.843938] bundle[1574]: {"timestamp":"2026-10-26T11:16:53.148Z","pid":1574,"message":"! #\u003cThread:0x0000747b90a62450 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 129.855454] bundle[1574]: {"timestamp":"2026-10-26T11:16:53.148Z","pid":1574,"message":"! #\u003cThread:0x0000747b90c6cae8 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 129.866736] bundle[1574]: {"timestamp":"2026-10-26T11:16:53.148Z","pid":1574,"message":"Use Ctrl-C to stop"} gitlab # [ 129.869461] bundle[1574]: {"timestamp":"2026-10-26T11:16:53.149Z","pid":1574,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 130.498494] bundle[1574]: {"timestamp":"2026-10-26T11:16:53.812Z","pid":1574,"message":"- Worker 1 (PID: 2149) booted in 0.61s, phase: 0"} gitlab # [ 130.503409] bundle[1574]: {"timestamp":"2026-10-26T11:16:53.817Z","pid":1574,"message":"- Worker 0 (PID: 2145) booted in 0.64s, phase: 0"} gitlab # [ 130.508137] systemd[1]: Started gitlab.service. gitlab # [ 130.510194] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 130.512879] systemd[1]: Starting setup-gitlab.service... gitlab # [ 130.527394] setup-gitlab-start[2182]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 132.423024] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:16:55 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 1875 gitlab # [ 132.428776] setup-gitlab-start[2182]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 132.428943] setup-gitlab-start[2182]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 132.456951] runuser[2200]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 132.819211] setup-gitlab-start[2201]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 132.819630] setup-gitlab-start[2201]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 132.821215] setup-gitlab-start[2201]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 133.387203] setup-gitlab-start[2201]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 133.387565] setup-gitlab-start[2201]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 133.389277] setup-gitlab-start[2201]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 139.893969] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:03.206Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"19dd7d8c74a987cc4dfd2b21","created_at":"2026-10-26T11:17:03.172Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46e3c250477bf4303b15a32b86f071a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.204Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-19dd7d8c74a987cc4dfd2b21: start","job_status":"start","queue_duration_s":0.002507,"scheduling_latency_s":0.002544} gitlab # [ 139.972867] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:03.286Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 139.999187] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:03.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"19dd7d8c74a987cc4dfd2b21","created_at":"2026-10-26T11:17:03.172Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46e3c250477bf4303b15a32b86f071a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.204Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-19dd7d8c74a987cc4dfd2b21: done: 0.105692 sec","job_status":"done","queue_duration_s":0.002507,"scheduling_latency_s":0.002544,"redis_calls":10,"redis_duration_s":0.012242,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001591,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004109,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00221313,"duration_s":0.105692,"completed_at":"2026-10-26T11:17:03.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015429,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 140.001354] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:03.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"07eaa3c134fdfa77c05d67f8","created_at":"2026-10-26T11:17:03.242Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ef19d1cf8f46e4863ae7900b4d108b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.258Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-07eaa3c134fdfa77c05d67f8: start","job_status":"start","queue_duration_s":0.05598,"scheduling_latency_s":0.056014} gitlab # [ 140.031994] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:03.345Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"07eaa3c134fdfa77c05d67f8","created_at":"2026-10-26T11:17:03.242Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ef19d1cf8f46e4863ae7900b4d108b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.258Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-07eaa3c134fdfa77c05d67f8: done: 0.030699 sec","job_status":"done","queue_duration_s":0.05598,"scheduling_latency_s":0.056014,"redis_calls":12,"redis_duration_s":0.004169,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00135,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001914,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000544204,"duration_s":0.030699,"completed_at":"2026-10-26T11:17:03.345Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001105,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 140.124509] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:03.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"59fea7ffdc37bde156b3c15b","created_at":"2026-10-26T11:17:03.285Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59b1914d9f2820968c6f278e14023017","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.435Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-59fea7ffdc37bde156b3c15b: start","job_status":"start","queue_duration_s":0.002184,"scheduling_latency_s":0.002231} gitlab # [ 140.220186] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:03.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"59fea7ffdc37bde156b3c15b","created_at":"2026-10-26T11:17:03.285Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59b1914d9f2820968c6f278e14023017","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.435Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-59fea7ffdc37bde156b3c15b: done: 0.095738 sec","job_status":"done","queue_duration_s":0.002184,"scheduling_latency_s":0.002231,"redis_calls":10,"redis_duration_s":0.005397,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001828,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000825,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000604825,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.095738,"completed_at":"2026-10-26T11:17:03.533Z","load_balancing_strategy":"primary","db_duration_s":0.040213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 140.224779] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:03.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"000434c8c3684c17377808e2","created_at":"2026-10-26T11:17:03.461Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d65a4a4247a818c28801d3385d5f7361","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.475Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-000434c8c3684c17377808e2: start","job_status":"start","queue_duration_s":0.06343,"scheduling_latency_s":0.063445} gitlab # [ 140.624312] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:03.937Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"000434c8c3684c17377808e2","created_at":"2026-10-26T11:17:03.461Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d65a4a4247a818c28801d3385d5f7361","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.475Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-000434c8c3684c17377808e2: done: 0.399149 sec","job_status":"done","queue_duration_s":0.06343,"scheduling_latency_s":0.063445,"redis_calls":14,"redis_duration_s":0.018210999999999998,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005593,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010272,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002346,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.103,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.1,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.181509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001011022,"exclusive_lock_hold_duration_s":0.352789809,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.399149,"completed_at":"2026-10-26T11:17:03.937Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.181488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 140.664771] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:03.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"58c8a9be99134b75789bf98c","created_at":"2026-10-26T11:17:03.486Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3f36b0341e94799d0c8df1a6b0d1c65","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.494Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-58c8a9be99134b75789bf98c: start","job_status":"start","queue_duration_s":0.483732,"scheduling_latency_s":0.483754} gitlab # [ 140.697555] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.011Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 140.711407] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.024Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"58c8a9be99134b75789bf98c","created_at":"2026-10-26T11:17:03.486Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3f36b0341e94799d0c8df1a6b0d1c65","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.494Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-58c8a9be99134b75789bf98c: done: 0.046262 sec","job_status":"done","queue_duration_s":0.483732,"scheduling_latency_s":0.483754,"redis_calls":10,"redis_duration_s":0.004383,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000383,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000460673,"duration_s":0.046262,"completed_at":"2026-10-26T11:17:04.024Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 140.750587] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ArchiveTracesCronWorker","jid":"0fe6bcb78747b0e0e4c2c668","created_at":"2026-10-26T11:17:03.498Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51ebdfdbb80e82277727f3d7bdbf3e55","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f0234f524ae629146c97646d3c809b290751f669b415a8b01cafe8f68b01506d","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.505Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ArchiveTracesCronWorker JID-0fe6bcb78747b0e0e4c2c668: start","job_status":"start","queue_duration_s":0.558576,"scheduling_latency_s":0.558608} gitlab # [ 140.822317] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.135Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ArchiveTracesCronWorker","jid":"0fe6bcb78747b0e0e4c2c668","created_at":"2026-10-26T11:17:03.498Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51ebdfdbb80e82277727f3d7bdbf3e55","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f0234f524ae629146c97646d3c809b290751f669b415a8b01cafe8f68b01506d","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.505Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ArchiveTracesCronWorker JID-0fe6bcb78747b0e0e4c2c668: done: 0.071605 sec","job_status":"done","queue_duration_s":0.558576,"scheduling_latency_s":0.558608,"redis_calls":12,"redis_duration_s":0.003053,"redis_read_bytes":11,"redis_write_bytes":1354,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000453,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":297,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":519,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000612928,"exclusive_lock_hold_duration_s":0.030106341000000002,"duration_s":0.071605,"completed_at":"2026-10-26T11:17:04.135Z","load_balancing_strategy":"primary","db_duration_s":0.014999,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 140.825407] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6b5a6d6a39c9a668db27a19b","created_at":"2026-10-26T11:17:03.534Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85dc6496934229a4c2840b88e432bcfb","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.546Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6b5a6d6a39c9a668db27a19b: start","job_status":"start","queue_duration_s":0.591923,"scheduling_latency_s":0.591993} gitlab # [ 140.858146] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.171Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6b5a6d6a39c9a668db27a19b","created_at":"2026-10-26T11:17:03.534Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85dc6496934229a4c2840b88e432bcfb","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.546Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6b5a6d6a39c9a668db27a19b: done: 0.03268 sec","job_status":"done","queue_duration_s":0.591923,"scheduling_latency_s":0.591993,"redis_calls":13,"redis_duration_s":0.005802,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001388,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002499,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001915,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008456661,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.03268,"completed_at":"2026-10-26T11:17:04.171Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005924,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 140.883556] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"faf0b4f1c1371498a034a215","created_at":"2026-10-26T11:17:03.563Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.574Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-faf0b4f1c1371498a034a215: start","job_status":"start","queue_duration_s":0.604105,"scheduling_latency_s":0.604121} gitlab # [ 140.949109] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"faf0b4f1c1371498a034a215","created_at":"2026-10-26T11:17:03.563Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.574Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-faf0b4f1c1371498a034a215: done: 0.083442 sec","job_status":"done","queue_duration_s":0.604105,"scheduling_latency_s":0.604121,"redis_calls":71,"redis_duration_s":0.022542,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.006755,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001044,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.012988,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367645,"duration_s":0.083442,"completed_at":"2026-10-26T11:17:04.261Z","load_balancing_strategy":"primary","db_duration_s":0.00504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 140.951817] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5294d82d187a5e8aa5201f04","created_at":"2026-10-26T11:17:03.588Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cbd01e19622aa1ebc93242c9f19bf50","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-26T11:17:03.607Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5294d82d187a5e8aa5201f04: start","job_status":"start","queue_duration_s":0.65843,"scheduling_latency_s":0.658446} gitlab # [ 140.964272] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.278Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 140.969560] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.283Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5294d82d187a5e8aa5201f04","created_at":"2026-10-26T11:17:03.588Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cbd01e19622aa1ebc93242c9f19bf50","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-26T11:17:03.607Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5294d82d187a5e8aa5201f04: done: 0.017693 sec","job_status":"done","queue_duration_s":0.65843,"scheduling_latency_s":0.658446,"redis_calls":10,"redis_duration_s":0.003725,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031708,"duration_s":0.017693,"completed_at":"2026-10-26T11:17:04.283Z","load_balancing_strategy":"primary","db_duration_s":0.000613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.004726] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b0c691bcac86a4714d1bc209","created_at":"2026-10-26T11:17:03.628Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcc960da015a433c5a54cd5d86669b9b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.639Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b0c691bcac86a4714d1bc209: start","job_status":"start","queue_duration_s":0.650043,"scheduling_latency_s":0.650057} gitlab # [ 141.053266] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b0c691bcac86a4714d1bc209","created_at":"2026-10-26T11:17:03.628Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcc960da015a433c5a54cd5d86669b9b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.639Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b0c691bcac86a4714d1bc209: done: 0.077466 sec","job_status":"done","queue_duration_s":0.650043,"scheduling_latency_s":0.650057,"redis_calls":12,"redis_duration_s":0.004972,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001356,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002504,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000535543,"exclusive_lock_hold_duration_s":0.008749157,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.077466,"completed_at":"2026-10-26T11:17:04.366Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.054917] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.368Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d2809cae60bd62bd9fe030a0","created_at":"2026-10-26T11:17:03.667Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b6568a5a15675e41f917a36b12b1b1a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.675Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d2809cae60bd62bd9fe030a0: start","job_status":"start","queue_duration_s":0.693097,"scheduling_latency_s":0.693112} gitlab # [ 141.099040] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d2809cae60bd62bd9fe030a0","created_at":"2026-10-26T11:17:03.667Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b6568a5a15675e41f917a36b12b1b1a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.675Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d2809cae60bd62bd9fe030a0: done: 0.019128 sec","job_status":"done","queue_duration_s":0.693097,"scheduling_latency_s":0.693112,"redis_calls":12,"redis_duration_s":0.0021709999999999998,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000290819,"exclusive_lock_hold_duration_s":0.00379294,"duration_s":0.019128,"completed_at":"2026-10-26T11:17:04.387Z","load_balancing_strategy":"primary","db_duration_s":0.001778,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.101390] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a19d20bf65265a79b0fd4681","created_at":"2026-10-26T11:17:03.683Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56b80b7d194bf0722af95cd88a2e36c5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-26T11:17:03.689Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a19d20bf65265a79b0fd4681: start","job_status":"start","queue_duration_s":0.699033,"scheduling_latency_s":0.699046} gitlab # [ 141.143710] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.395Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 141.144601] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.400Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a19d20bf65265a79b0fd4681","created_at":"2026-10-26T11:17:03.683Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56b80b7d194bf0722af95cd88a2e36c5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-26T11:17:03.689Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a19d20bf65265a79b0fd4681: done: 0.011479 sec","job_status":"done","queue_duration_s":0.699033,"scheduling_latency_s":0.699046,"redis_calls":10,"redis_duration_s":0.0011409999999999999,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000221816,"duration_s":0.011479,"completed_at":"2026-10-26T11:17:04.400Z","load_balancing_strategy":"primary","db_duration_s":0.000224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.182741] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.401Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e2c276f960d7626cc75717fe","created_at":"2026-10-26T11:17:03.696Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86f677f9b1ed9ac75cff78a5d1973b1f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.703Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e2c276f960d7626cc75717fe: start","job_status":"start","queue_duration_s":0.697487,"scheduling_latency_s":0.697502} gitlab # [ 141.183650] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.424Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e2c276f960d7626cc75717fe","created_at":"2026-10-26T11:17:03.696Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86f677f9b1ed9ac75cff78a5d1973b1f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.703Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e2c276f960d7626cc75717fe: done: 0.022971 sec","job_status":"done","queue_duration_s":0.697487,"scheduling_latency_s":0.697502,"redis_calls":12,"redis_duration_s":0.001577,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000351,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000526,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000284114,"exclusive_lock_hold_duration_s":0.010610008,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.022971,"completed_at":"2026-10-26T11:17:04.423Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.205310] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.424Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"021fc04edb741138d1860193","created_at":"2026-10-26T11:17:03.712Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ae5598e7506712875fb73a72c84e82e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-26T11:17:03.721Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-021fc04edb741138d1860193: start","job_status":"start","queue_duration_s":0.703302,"scheduling_latency_s":0.703316} gitlab # [ 141.251324] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"021fc04edb741138d1860193","created_at":"2026-10-26T11:17:03.712Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ae5598e7506712875fb73a72c84e82e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-26T11:17:03.721Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-021fc04edb741138d1860193: done: 0.019382 sec","job_status":"done","queue_duration_s":0.703302,"scheduling_latency_s":0.703316,"redis_calls":10,"redis_duration_s":0.001297,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000315,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000188851,"duration_s":0.019382,"completed_at":"2026-10-26T11:17:04.444Z","load_balancing_strategy":"primary","db_duration_s":0.002186,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.252648] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"affd73e5947c3c49efe413e5","created_at":"2026-10-26T11:17:03.729Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fc2468a4837fe7e4ec1305ac4660750","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.734Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-affd73e5947c3c49efe413e5: start","job_status":"start","queue_duration_s":0.710414,"scheduling_latency_s":0.710428} gitlab # [ 141.298588] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.465Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"affd73e5947c3c49efe413e5","created_at":"2026-10-26T11:17:03.729Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fc2468a4837fe7e4ec1305ac4660750","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.734Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-affd73e5947c3c49efe413e5: done: 0.020534 sec","job_status":"done","queue_duration_s":0.710414,"scheduling_latency_s":0.710428,"redis_calls":19,"redis_duration_s":0.002242,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000192,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00018941,"duration_s":0.020534,"completed_at":"2026-10-26T11:17:04.465Z","load_balancing_strategy":"primary","db_duration_s":0.001015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.302510] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.466Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"44b61d2f33496cdbad8faa35","created_at":"2026-10-26T11:17:03.747Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"369e5fca5072d51437a08941987d1750","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.756Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-44b61d2f33496cdbad8faa35: start","job_status":"start","queue_duration_s":0.710248,"scheduling_latency_s":0.710261} gitlab # [ 141.345102] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.485Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"44b61d2f33496cdbad8faa35","created_at":"2026-10-26T11:17:03.747Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"369e5fca5072d51437a08941987d1750","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.756Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-44b61d2f33496cdbad8faa35: done: 0.018712 sec","job_status":"done","queue_duration_s":0.710248,"scheduling_latency_s":0.710261,"redis_calls":16,"redis_duration_s":0.0018909999999999999,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.000967,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189689,"duration_s":0.018712,"completed_at":"2026-10-26T11:17:04.485Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00254,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.351713] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.486Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"bd3df36ee586bc74f9a6bf0d","created_at":"2026-10-26T11:17:03.764Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5011e96471416c9d6cbb51b238319ea","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.770Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-bd3df36ee586bc74f9a6bf0d: start","job_status":"start","queue_duration_s":0.715959,"scheduling_latency_s":0.715971} gitlab # [ 141.364214] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.505Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"bd3df36ee586bc74f9a6bf0d","created_at":"2026-10-26T11:17:03.764Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5011e96471416c9d6cbb51b238319ea","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.770Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-bd3df36ee586bc74f9a6bf0d: done: 0.019388 sec","job_status":"done","queue_duration_s":0.715959,"scheduling_latency_s":0.715971,"redis_calls":10,"redis_duration_s":0.006477,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000225,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005335,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000921626,"duration_s":0.019388,"completed_at":"2026-10-26T11:17:04.505Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001401,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.409152] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5ab5fbaf325e48e4fbc14a9d","created_at":"2026-10-26T11:17:03.778Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"580244fe1c79ebfbb555f4195f8ae017","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.786Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5ab5fbaf325e48e4fbc14a9d: start","job_status":"start","queue_duration_s":0.722516,"scheduling_latency_s":0.72253} gitlab # [ 141.414244] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.521Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 141.417172] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5ab5fbaf325e48e4fbc14a9d","created_at":"2026-10-26T11:17:03.778Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"580244fe1c79ebfbb555f4195f8ae017","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.786Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5ab5fbaf325e48e4fbc14a9d: done: 0.020082 sec","job_status":"done","queue_duration_s":0.722516,"scheduling_latency_s":0.72253,"redis_calls":10,"redis_duration_s":0.007653,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001493,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004655,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001505,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000965765,"duration_s":0.020082,"completed_at":"2026-10-26T11:17:04.529Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.455652] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4be28bf8392fa828f0a95523","created_at":"2026-10-26T11:17:03.810Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fbb2fec09cffb97833c3255c3de85cd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.818Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4be28bf8392fa828f0a95523: start","job_status":"start","queue_duration_s":0.711482,"scheduling_latency_s":0.711495} gitlab # [ 141.481035] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4be28bf8392fa828f0a95523","created_at":"2026-10-26T11:17:03.810Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fbb2fec09cffb97833c3255c3de85cd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.818Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4be28bf8392fa828f0a95523: done: 0.264059 sec","job_status":"done","queue_duration_s":0.711482,"scheduling_latency_s":0.711495,"redis_calls":565,"redis_duration_s":0.104051,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000355,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.102962,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.185104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218185,"duration_s":0.264059,"completed_at":"2026-10-26T11:17:04.794Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.532136] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.800Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"3f14f0c43fbb103b81ea441d","created_at":"2026-10-26T11:17:03.824Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b960fd5a8be378b7d4639f65c86d846a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.834Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-3f14f0c43fbb103b81ea441d: start","job_status":"start","queue_duration_s":0.96577,"scheduling_latency_s":0.965785} gitlab # [ 141.532740] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.811Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 141.533227] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.816Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"3f14f0c43fbb103b81ea441d","created_at":"2026-10-26T11:17:03.824Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b960fd5a8be378b7d4639f65c86d846a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.834Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-3f14f0c43fbb103b81ea441d: done: 0.015883 sec","job_status":"done","queue_duration_s":0.96577,"scheduling_latency_s":0.965785,"redis_calls":10,"redis_duration_s":0.0037340000000000003,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002318,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000215949,"duration_s":0.015883,"completed_at":"2026-10-26T11:17:04.816Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000438,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.572139] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.817Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"47b4a1cdaba8e6315d99ad44","created_at":"2026-10-26T11:17:03.850Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4491b96ca27a8a51bb4bb94cedb89a8a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.860Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-47b4a1cdaba8e6315d99ad44: start","job_status":"start","queue_duration_s":0.95704,"scheduling_latency_s":0.957054} gitlab # [ 141.572824] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"47b4a1cdaba8e6315d99ad44","created_at":"2026-10-26T11:17:03.850Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4491b96ca27a8a51bb4bb94cedb89a8a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.860Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-47b4a1cdaba8e6315d99ad44: done: 0.011941 sec","job_status":"done","queue_duration_s":0.95704,"scheduling_latency_s":0.957054,"redis_calls":10,"redis_duration_s":0.001135,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208127,"duration_s":0.011941,"completed_at":"2026-10-26T11:17:04.829Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.637869] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"668ca29ba860b2f52ff5b045","created_at":"2026-10-26T11:17:03.872Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6b3355c1017284089a33584517a9da6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.886Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-668ca29ba860b2f52ff5b045: start","job_status":"start","queue_duration_s":0.943329,"scheduling_latency_s":0.943342} gitlab # [ 141.638649] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.843Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"668ca29ba860b2f52ff5b045","created_at":"2026-10-26T11:17:03.872Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-988e33e0231e47ed","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6b3355c1017284089a33584517a9da6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:03.886Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-668ca29ba860b2f52ff5b045: done: 0.013407 sec","job_status":"done","queue_duration_s":0.943329,"scheduling_latency_s":0.943342,"redis_calls":12,"redis_duration_s":0.001451,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000307302,"exclusive_lock_hold_duration_s":0.0020768,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.013407,"completed_at":"2026-10-26T11:17:04.843Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000951,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.694304] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e6ea46a8e47d18a7f43c4a1","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e6ea46a8e47d18a7f43c4a1: start","job_status":"start","queue_duration_s":0.589781,"scheduling_latency_s":0.589794} gitlab # [ 141.694430] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e6ea46a8e47d18a7f43c4a1","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e6ea46a8e47d18a7f43c4a1: done: 0.014396 sec","job_status":"done","queue_duration_s":0.589781,"scheduling_latency_s":0.589794,"redis_calls":16,"redis_duration_s":0.002512,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00020226,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014396,"completed_at":"2026-10-26T11:17:04.858Z","load_balancing_strategy":"primary","db_duration_s":0.000243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.704550] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aeef4e8a2937543c5425fa2","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aeef4e8a2937543c5425fa2: start","job_status":"start","queue_duration_s":0.605159,"scheduling_latency_s":0.605172} gitlab # [ 141.752152] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aeef4e8a2937543c5425fa2","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aeef4e8a2937543c5425fa2: done: 0.009633 sec","job_status":"done","queue_duration_s":0.605159,"scheduling_latency_s":0.605172,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009633,"completed_at":"2026-10-26T11:17:04.869Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.753118] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afeba8e18277e8d52d6c7e04","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afeba8e18277e8d52d6c7e04: start","job_status":"start","queue_duration_s":0.615719,"scheduling_latency_s":0.615732} gitlab # [ 141.760844] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afeba8e18277e8d52d6c7e04","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afeba8e18277e8d52d6c7e04: done: 0.009552 sec","job_status":"done","queue_duration_s":0.615719,"scheduling_latency_s":0.615732,"redis_calls":13,"redis_duration_s":0.0015700000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009552,"completed_at":"2026-10-26T11:17:04.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.813252] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c53765867525ef025beffad0","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c53765867525ef025beffad0: start","job_status":"start","queue_duration_s":0.626064,"scheduling_latency_s":0.626077} gitlab # [ 141.813943] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c53765867525ef025beffad0","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c53765867525ef025beffad0: done: 0.019194 sec","job_status":"done","queue_duration_s":0.626064,"scheduling_latency_s":0.626077,"redis_calls":13,"redis_duration_s":0.011021,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001334,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009687,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019194,"completed_at":"2026-10-26T11:17:04.899Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.843376] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de0403254e16bdbecad28791","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de0403254e16bdbecad28791: start","job_status":"start","queue_duration_s":0.647806,"scheduling_latency_s":0.647822} gitlab # [ 141.854069] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de0403254e16bdbecad28791","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de0403254e16bdbecad28791: done: 0.015547 sec","job_status":"done","queue_duration_s":0.647806,"scheduling_latency_s":0.647822,"redis_calls":13,"redis_duration_s":0.006603,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002209,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004394,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015547,"completed_at":"2026-10-26T11:17:04.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.892762] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc0dd8bca3796c41c5223c3","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc0dd8bca3796c41c5223c3: start","job_status":"start","queue_duration_s":0.664173,"scheduling_latency_s":0.664186} gitlab # [ 141.896837] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc0dd8bca3796c41c5223c3","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc0dd8bca3796c41c5223c3: done: 0.00969 sec","job_status":"done","queue_duration_s":0.664173,"scheduling_latency_s":0.664186,"redis_calls":13,"redis_duration_s":0.0014490000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00969,"completed_at":"2026-10-26T11:17:04.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.935683] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9153dd523340746e80501586","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9153dd523340746e80501586: start","job_status":"start","queue_duration_s":0.674694,"scheduling_latency_s":0.674707} gitlab # [ 141.942183] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9153dd523340746e80501586","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9153dd523340746e80501586: done: 0.009456 sec","job_status":"done","queue_duration_s":0.674694,"scheduling_latency_s":0.674707,"redis_calls":13,"redis_duration_s":0.001408,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009456,"completed_at":"2026-10-26T11:17:04.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.981396] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a92bec54560282f3e8d961fd","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a92bec54560282f3e8d961fd: start","job_status":"start","queue_duration_s":0.684945,"scheduling_latency_s":0.684959} gitlab # [ 141.987729] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a92bec54560282f3e8d961fd","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a92bec54560282f3e8d961fd: done: 0.009184 sec","job_status":"done","queue_duration_s":0.684945,"scheduling_latency_s":0.684959,"redis_calls":13,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009184,"completed_at":"2026-10-26T11:17:04.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.023224] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c01a2379d8a331a46b9058c6","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c01a2379d8a331a46b9058c6: start","job_status":"start","queue_duration_s":0.695057,"scheduling_latency_s":0.69507} gitlab # [ 142.066598] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c01a2379d8a331a46b9058c6","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c01a2379d8a331a46b9058c6: done: 0.018089 sec","job_status":"done","queue_duration_s":0.695057,"scheduling_latency_s":0.69507,"redis_calls":13,"redis_duration_s":0.009714,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018089,"completed_at":"2026-10-26T11:17:04.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.068599] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"209ad3d2d9b378e6629ab3d9","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-209ad3d2d9b378e6629ab3d9: start","job_status":"start","queue_duration_s":0.714252,"scheduling_latency_s":0.714266} gitlab # [ 142.112324] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"209ad3d2d9b378e6629ab3d9","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-209ad3d2d9b378e6629ab3d9: done: 0.009681 sec","job_status":"done","queue_duration_s":0.714252,"scheduling_latency_s":0.714266,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009681,"completed_at":"2026-10-26T11:17:04.978Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.113644] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d06b7303d622aaf435adf40","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d06b7303d622aaf435adf40: start","job_status":"start","queue_duration_s":0.724892,"scheduling_latency_s":0.724905} gitlab # [ 142.153689] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d06b7303d622aaf435adf40","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d06b7303d622aaf435adf40: done: 0.00949 sec","job_status":"done","queue_duration_s":0.724892,"scheduling_latency_s":0.724905,"redis_calls":13,"redis_duration_s":0.0015310000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00949,"completed_at":"2026-10-26T11:17:04.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.159586] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:04.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a42af845ebcfd9d556b2c882","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a42af845ebcfd9d556b2c882: start","job_status":"start","queue_duration_s":0.735327,"scheduling_latency_s":0.735341} gitlab # [ 142.170618] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a42af845ebcfd9d556b2c882","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a42af845ebcfd9d556b2c882: done: 0.011994 sec","job_status":"done","queue_duration_s":0.735327,"scheduling_latency_s":0.735341,"redis_calls":13,"redis_duration_s":0.0017929999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011994,"completed_at":"2026-10-26T11:17:05.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.214609] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80adcb2a93ae1b964f736a4e","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80adcb2a93ae1b964f736a4e: start","job_status":"start","queue_duration_s":0.748264,"scheduling_latency_s":0.748277} gitlab # [ 142.216064] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80adcb2a93ae1b964f736a4e","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80adcb2a93ae1b964f736a4e: done: 0.019007 sec","job_status":"done","queue_duration_s":0.748264,"scheduling_latency_s":0.748277,"redis_calls":13,"redis_duration_s":0.01051,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019007,"completed_at":"2026-10-26T11:17:05.021Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.255867] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a42f1be215f2df109cf4f756","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a42f1be215f2df109cf4f756: start","job_status":"start","queue_duration_s":0.769838,"scheduling_latency_s":0.769852} gitlab # [ 142.261115] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a42f1be215f2df109cf4f756","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a42f1be215f2df109cf4f756: done: 0.010638 sec","job_status":"done","queue_duration_s":0.769838,"scheduling_latency_s":0.769852,"redis_calls":13,"redis_duration_s":0.0017209999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010638,"completed_at":"2026-10-26T11:17:05.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.298732] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77eff1162cf1959e0c29527f","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77eff1162cf1959e0c29527f: start","job_status":"start","queue_duration_s":0.781252,"scheduling_latency_s":0.781265} gitlab # [ 142.305891] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77eff1162cf1959e0c29527f","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77eff1162cf1959e0c29527f: done: 0.009373 sec","job_status":"done","queue_duration_s":0.781252,"scheduling_latency_s":0.781265,"redis_calls":13,"redis_duration_s":0.001517,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000444,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009373,"completed_at":"2026-10-26T11:17:05.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.372988] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff089e22ca549f5cf3bd0464","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff089e22ca549f5cf3bd0464: start","job_status":"start","queue_duration_s":0.791419,"scheduling_latency_s":0.791432} gitlab # [ 142.373653] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff089e22ca549f5cf3bd0464","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff089e22ca549f5cf3bd0464: done: 0.009564 sec","job_status":"done","queue_duration_s":0.791419,"scheduling_latency_s":0.791432,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009564,"completed_at":"2026-10-26T11:17:05.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.385210] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b18a5c92da1109c311caf1a6","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b18a5c92da1109c311caf1a6: start","job_status":"start","queue_duration_s":0.801764,"scheduling_latency_s":0.801777} gitlab # [ 142.428759] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b18a5c92da1109c311caf1a6","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b18a5c92da1109c311caf1a6: done: 0.009325 sec","job_status":"done","queue_duration_s":0.801764,"scheduling_latency_s":0.801777,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009325,"completed_at":"2026-10-26T11:17:05.065Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.429904] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56a3630feabd46d2e5078721","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56a3630feabd46d2e5078721: start","job_status":"start","queue_duration_s":0.816802,"scheduling_latency_s":0.816817} gitlab # [ 142.440817] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56a3630feabd46d2e5078721","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56a3630feabd46d2e5078721: done: 0.017436 sec","job_status":"done","queue_duration_s":0.816802,"scheduling_latency_s":0.816817,"redis_calls":13,"redis_duration_s":0.00834,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017436,"completed_at":"2026-10-26T11:17:05.088Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.479977] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56a022f830613eb6d1b9f156","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56a022f830613eb6d1b9f156: start","job_status":"start","queue_duration_s":0.835064,"scheduling_latency_s":0.835077} gitlab # [ 142.485536] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56a022f830613eb6d1b9f156","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56a022f830613eb6d1b9f156: done: 0.00936 sec","job_status":"done","queue_duration_s":0.835064,"scheduling_latency_s":0.835077,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00936,"completed_at":"2026-10-26T11:17:05.098Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.531514] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b735227c1ad94b6c89e497a5","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b735227c1ad94b6c89e497a5: start","job_status":"start","queue_duration_s":0.845463,"scheduling_latency_s":0.845475} gitlab # [ 142.532291] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b735227c1ad94b6c89e497a5","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b735227c1ad94b6c89e497a5: done: 0.009322 sec","job_status":"done","queue_duration_s":0.845463,"scheduling_latency_s":0.845475,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009322,"completed_at":"2026-10-26T11:17:05.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.601814] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a5c7a736ae313d7a11de62b","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a5c7a736ae313d7a11de62b: start","job_status":"start","queue_duration_s":0.855759,"scheduling_latency_s":0.855773} gitlab # [ 142.602710] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a5c7a736ae313d7a11de62b","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a5c7a736ae313d7a11de62b: done: 0.009288 sec","job_status":"done","queue_duration_s":0.855759,"scheduling_latency_s":0.855773,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009288,"completed_at":"2026-10-26T11:17:05.119Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.609651] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a24ba81ae35eaf448d73caa4","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a24ba81ae35eaf448d73caa4: start","job_status":"start","queue_duration_s":0.86598,"scheduling_latency_s":0.865993} gitlab # [ 142.620636] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a24ba81ae35eaf448d73caa4","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a24ba81ae35eaf448d73caa4: done: 0.016097 sec","job_status":"done","queue_duration_s":0.86598,"scheduling_latency_s":0.865993,"redis_calls":13,"redis_duration_s":0.007961,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006495,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016097,"completed_at":"2026-10-26T11:17:05.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.662270] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f74d977cef8fb625e266a9af","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f74d977cef8fb625e266a9af: start","job_status":"start","queue_duration_s":0.884937,"scheduling_latency_s":0.884951} gitlab # [ 142.665647] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f74d977cef8fb625e266a9af","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f74d977cef8fb625e266a9af: done: 0.017619 sec","job_status":"done","queue_duration_s":0.884937,"scheduling_latency_s":0.884951,"redis_calls":13,"redis_duration_s":0.008664,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006736,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017619,"completed_at":"2026-10-26T11:17:05.156Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.709102] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"443e8a6258123ab316bf358c","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-443e8a6258123ab316bf358c: start","job_status":"start","queue_duration_s":0.906837,"scheduling_latency_s":0.906854} gitlab # [ 142.710500] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"443e8a6258123ab316bf358c","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-443e8a6258123ab316bf358c: done: 0.011976 sec","job_status":"done","queue_duration_s":0.906837,"scheduling_latency_s":0.906854,"redis_calls":13,"redis_duration_s":0.0029419999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011976,"completed_at":"2026-10-26T11:17:05.173Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.769646] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"893f7246af3424efe10a1d1c","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-893f7246af3424efe10a1d1c: start","job_status":"start","queue_duration_s":0.91961,"scheduling_latency_s":0.919648} gitlab # [ 142.770591] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"893f7246af3424efe10a1d1c","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-893f7246af3424efe10a1d1c: done: 0.009493 sec","job_status":"done","queue_duration_s":0.91961,"scheduling_latency_s":0.919648,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009493,"completed_at":"2026-10-26T11:17:05.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.825840] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc23e690866b43d08e5afc21","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc23e690866b43d08e5afc21: start","job_status":"start","queue_duration_s":0.929894,"scheduling_latency_s":0.929907} gitlab # [ 142.826628] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc23e690866b43d08e5afc21","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc23e690866b43d08e5afc21: done: 0.009486 sec","job_status":"done","queue_duration_s":0.929894,"scheduling_latency_s":0.929907,"redis_calls":13,"redis_duration_s":0.001404,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009486,"completed_at":"2026-10-26T11:17:05.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.834899] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21ea9ee56e2e0dc0b56e10b6","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21ea9ee56e2e0dc0b56e10b6: start","job_status":"start","queue_duration_s":0.940164,"scheduling_latency_s":0.940177} gitlab # [ 142.880932] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21ea9ee56e2e0dc0b56e10b6","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21ea9ee56e2e0dc0b56e10b6: done: 0.009351 sec","job_status":"done","queue_duration_s":0.940164,"scheduling_latency_s":0.940177,"redis_calls":13,"redis_duration_s":0.001399,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009351,"completed_at":"2026-10-26T11:17:05.203Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.881905] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a227867e563f9b33a8b74033","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a227867e563f9b33a8b74033: start","job_status":"start","queue_duration_s":0.950318,"scheduling_latency_s":0.950339} gitlab # [ 142.891040] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a227867e563f9b33a8b74033","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a227867e563f9b33a8b74033: done: 0.012198 sec","job_status":"done","queue_duration_s":0.950318,"scheduling_latency_s":0.950339,"redis_calls":13,"redis_duration_s":0.004131,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012198,"completed_at":"2026-10-26T11:17:05.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.929168] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b571c8adcebfc3fca3a5b30a","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b571c8adcebfc3fca3a5b30a: start","job_status":"start","queue_duration_s":0.963315,"scheduling_latency_s":0.963335} gitlab # [ 142.973036] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b571c8adcebfc3fca3a5b30a","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b571c8adcebfc3fca3a5b30a: done: 0.009508 sec","job_status":"done","queue_duration_s":0.963315,"scheduling_latency_s":0.963335,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000449,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009508,"completed_at":"2026-10-26T11:17:05.227Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.974128] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c276b7f6a3ee741d2665f86","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c276b7f6a3ee741d2665f86: start","job_status":"start","queue_duration_s":0.973586,"scheduling_latency_s":0.973599} gitlab # [ 142.981609] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c276b7f6a3ee741d2665f86","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c276b7f6a3ee741d2665f86: done: 0.009243 sec","job_status":"done","queue_duration_s":0.973586,"scheduling_latency_s":0.973599,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009243,"completed_at":"2026-10-26T11:17:05.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.024612] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c1242624907c5e5f57f5889","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c1242624907c5e5f57f5889: start","job_status":"start","queue_duration_s":0.983777,"scheduling_latency_s":0.983791} gitlab # [ 143.026657] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c1242624907c5e5f57f5889","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c1242624907c5e5f57f5889: done: 0.009477 sec","job_status":"done","queue_duration_s":0.983777,"scheduling_latency_s":0.983791,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000451,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009477,"completed_at":"2026-10-26T11:17:05.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.071154] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6eccaec44d102f5e4f87b76c","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6eccaec44d102f5e4f87b76c: start","job_status":"start","queue_duration_s":0.994174,"scheduling_latency_s":0.994187} gitlab # [ 143.071889] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6eccaec44d102f5e4f87b76c","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6eccaec44d102f5e4f87b76c: done: 0.013151 sec","job_status":"done","queue_duration_s":0.994174,"scheduling_latency_s":0.994187,"redis_calls":13,"redis_duration_s":0.002628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001409,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013151,"completed_at":"2026-10-26T11:17:05.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.129774] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6024b495015adb7de30868f","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6024b495015adb7de30868f: start","job_status":"start","queue_duration_s":1.008398,"scheduling_latency_s":1.008411} gitlab # [ 143.130130] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6024b495015adb7de30868f","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6024b495015adb7de30868f: done: 0.009371 sec","job_status":"done","queue_duration_s":1.008398,"scheduling_latency_s":1.008411,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009371,"completed_at":"2026-10-26T11:17:05.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.151164] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e8398719f24a324742c540e","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e8398719f24a324742c540e: start","job_status":"start","queue_duration_s":1.018708,"scheduling_latency_s":1.018722} gitlab # [ 143.162280] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e8398719f24a324742c540e","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e8398719f24a324742c540e: done: 0.00945 sec","job_status":"done","queue_duration_s":1.018708,"scheduling_latency_s":1.018722,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00945,"completed_at":"2026-10-26T11:17:05.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.197127] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"882265fd2d872264cf5f0d4e","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-882265fd2d872264cf5f0d4e: start","job_status":"start","queue_duration_s":1.029139,"scheduling_latency_s":1.029152} gitlab # [ 143.208178] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"882265fd2d872264cf5f0d4e","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-882265fd2d872264cf5f0d4e: done: 0.009208 sec","job_status":"done","queue_duration_s":1.029139,"scheduling_latency_s":1.029152,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009208,"completed_at":"2026-10-26T11:17:05.292Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.248855] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d19bda8b0ed34ebdc001537","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d19bda8b0ed34ebdc001537: start","job_status":"start","queue_duration_s":1.039146,"scheduling_latency_s":1.039159} gitlab # [ 143.253125] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d19bda8b0ed34ebdc001537","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d19bda8b0ed34ebdc001537: done: 0.020267 sec","job_status":"done","queue_duration_s":1.039146,"scheduling_latency_s":1.039159,"redis_calls":13,"redis_duration_s":0.009415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020267,"completed_at":"2026-10-26T11:17:05.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.304067] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dba6c7e24186b4851ade61b1","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dba6c7e24186b4851ade61b1: start","job_status":"start","queue_duration_s":1.062846,"scheduling_latency_s":1.06286} gitlab # [ 143.304871] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dba6c7e24186b4851ade61b1","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dba6c7e24186b4851ade61b1: done: 0.019362 sec","job_status":"done","queue_duration_s":1.062846,"scheduling_latency_s":1.06286,"redis_calls":13,"redis_duration_s":0.010294000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00287,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007424,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019362,"completed_at":"2026-10-26T11:17:05.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.332964] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb43f04ab625236df7201534","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb43f04ab625236df7201534: start","job_status":"start","queue_duration_s":1.083195,"scheduling_latency_s":1.083208} gitlab # [ 143.371631] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb43f04ab625236df7201534","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb43f04ab625236df7201534: done: 0.011275 sec","job_status":"done","queue_duration_s":1.083195,"scheduling_latency_s":1.083208,"redis_calls":13,"redis_duration_s":0.0027489999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001403,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011275,"completed_at":"2026-10-26T11:17:05.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.377661] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbc29e1ab2b90ea6397d2ae0","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbc29e1ab2b90ea6397d2ae0: start","job_status":"start","queue_duration_s":1.095291,"scheduling_latency_s":1.095304} gitlab # [ 143.419840] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbc29e1ab2b90ea6397d2ae0","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbc29e1ab2b90ea6397d2ae0: done: 0.009753 sec","job_status":"done","queue_duration_s":1.095291,"scheduling_latency_s":1.095304,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000449,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009753,"completed_at":"2026-10-26T11:17:05.359Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.422656] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"580a71c14c448fc2707de371","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-580a71c14c448fc2707de371: start","job_status":"start","queue_duration_s":1.105832,"scheduling_latency_s":1.105847} gitlab # [ 143.433607] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"580a71c14c448fc2707de371","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-580a71c14c448fc2707de371: done: 0.009213 sec","job_status":"done","queue_duration_s":1.105832,"scheduling_latency_s":1.105847,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009213,"completed_at":"2026-10-26T11:17:05.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.488194] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f740be4f54a95d7ba78dc8f","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f740be4f54a95d7ba78dc8f: start","job_status":"start","queue_duration_s":1.115984,"scheduling_latency_s":1.115997} gitlab # [ 143.488904] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f740be4f54a95d7ba78dc8f","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f740be4f54a95d7ba78dc8f: done: 0.009383 sec","job_status":"done","queue_duration_s":1.115984,"scheduling_latency_s":1.115997,"redis_calls":13,"redis_duration_s":0.0015539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009383,"completed_at":"2026-10-26T11:17:05.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.514016] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15e333b45372fc802635c285","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15e333b45372fc802635c285: start","job_status":"start","queue_duration_s":1.128824,"scheduling_latency_s":1.128837} gitlab # [ 143.525093] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15e333b45372fc802635c285","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15e333b45372fc802635c285: done: 0.010611 sec","job_status":"done","queue_duration_s":1.128824,"scheduling_latency_s":1.128837,"redis_calls":13,"redis_duration_s":0.002632,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00165,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010611,"completed_at":"2026-10-26T11:17:05.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.568828] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"570fa2fde129194d08f9b784","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-570fa2fde129194d08f9b784: start","job_status":"start","queue_duration_s":1.140518,"scheduling_latency_s":1.140531} gitlab # [ 143.570240] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"570fa2fde129194d08f9b784","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-570fa2fde129194d08f9b784: done: 0.009217 sec","job_status":"done","queue_duration_s":1.140518,"scheduling_latency_s":1.140531,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009217,"completed_at":"2026-10-26T11:17:05.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.636985] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a34b1878a8b13d2965cf1f28","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a34b1878a8b13d2965cf1f28: start","job_status":"start","queue_duration_s":1.150736,"scheduling_latency_s":1.150751} gitlab # [ 143.637726] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a34b1878a8b13d2965cf1f28","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a34b1878a8b13d2965cf1f28: done: 0.009262 sec","job_status":"done","queue_duration_s":1.150736,"scheduling_latency_s":1.150751,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000444,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009262,"completed_at":"2026-10-26T11:17:05.414Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.650223] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6450af29066093257758138","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6450af29066093257758138: start","job_status":"start","queue_duration_s":1.160941,"scheduling_latency_s":1.160954} gitlab # [ 143.687989] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6450af29066093257758138","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6450af29066093257758138: done: 0.009146 sec","job_status":"done","queue_duration_s":1.160941,"scheduling_latency_s":1.160954,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009146,"completed_at":"2026-10-26T11:17:05.424Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.727694] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d85a940a2595659578d3934c","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d85a940a2595659578d3934c: start","job_status":"start","queue_duration_s":1.171148,"scheduling_latency_s":1.171162} gitlab # [ 143.728450] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d85a940a2595659578d3934c","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d85a940a2595659578d3934c: done: 0.01206 sec","job_status":"done","queue_duration_s":1.171148,"scheduling_latency_s":1.171162,"redis_calls":13,"redis_duration_s":0.001471,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01206,"completed_at":"2026-10-26T11:17:05.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.740558] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d2aa987423afee0d351cbe2","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d2aa987423afee0d351cbe2: start","job_status":"start","queue_duration_s":1.183898,"scheduling_latency_s":1.183912} gitlab # [ 143.751439] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d2aa987423afee0d351cbe2","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d2aa987423afee0d351cbe2: done: 0.009306 sec","job_status":"done","queue_duration_s":1.183898,"scheduling_latency_s":1.183912,"redis_calls":13,"redis_duration_s":0.00155,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000449,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009306,"completed_at":"2026-10-26T11:17:05.447Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.808190] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f13b4454631c431aa83fef3","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f13b4454631c431aa83fef3: start","job_status":"start","queue_duration_s":1.193989,"scheduling_latency_s":1.194001} gitlab # [ 143.808922] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f13b4454631c431aa83fef3","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f13b4454631c431aa83fef3: done: 0.009359 sec","job_status":"done","queue_duration_s":1.193989,"scheduling_latency_s":1.194001,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000453,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009359,"completed_at":"2026-10-26T11:17:05.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.850069] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce358df6930b4d368eb8a712","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce358df6930b4d368eb8a712: start","job_status":"start","queue_duration_s":1.204184,"scheduling_latency_s":1.204197} gitlab # [ 143.850832] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce358df6930b4d368eb8a712","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce358df6930b4d368eb8a712: done: 0.009459 sec","job_status":"done","queue_duration_s":1.204184,"scheduling_latency_s":1.204197,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009459,"completed_at":"2026-10-26T11:17:05.467Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.897640] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bc06df68dcf9a9b8b28fd58","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bc06df68dcf9a9b8b28fd58: start","job_status":"start","queue_duration_s":1.21791,"scheduling_latency_s":1.217923} gitlab # [ 143.898541] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bc06df68dcf9a9b8b28fd58","created_at":"2026-10-26T11:17:04.202Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-fd5fa974d56b4c4b","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b21fdb992a5f56a455fb7fa9648e9b55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.254Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bc06df68dcf9a9b8b28fd58: done: 0.017292 sec","job_status":"done","queue_duration_s":1.21791,"scheduling_latency_s":1.217923,"redis_calls":13,"redis_duration_s":0.009001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006416,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017292,"completed_at":"2026-10-26T11:17:05.489Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.921500] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.490Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2387a3358d196eb7e9000cc7","created_at":"2026-10-26T11:17:04.454Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-3ec09794f1ee4e5a","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5fc2468a4837fe7e4ec1305ac4660750","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.461Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2387a3358d196eb7e9000cc7: start","job_status":"start","queue_duration_s":1.029386,"scheduling_latency_s":1.029402} gitlab # [ 143.966869] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.501Z","message":"No existing merge request to be cleaned up."} gitlab # [ 143.967685] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.509Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2387a3358d196eb7e9000cc7","created_at":"2026-10-26T11:17:04.454Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-3ec09794f1ee4e5a","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5fc2468a4837fe7e4ec1305ac4660750","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.461Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2387a3358d196eb7e9000cc7: done: 0.018961 sec","job_status":"done","queue_duration_s":1.029386,"scheduling_latency_s":1.029402,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000705,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203937,"duration_s":0.018961,"completed_at":"2026-10-26T11:17:05.509Z","load_balancing_strategy":"primary","db_duration_s":0.002403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.968762] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.510Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2fc73c5e2fd51dfbd2d40128","created_at":"2026-10-26T11:17:04.454Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-3ec09794f1ee4e5a","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5fc2468a4837fe7e4ec1305ac4660750","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.461Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2fc73c5e2fd51dfbd2d40128: start","job_status":"start","queue_duration_s":1.049161,"scheduling_latency_s":1.049174} gitlab # [ 143.978850] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.516Z","message":"No existing merge request to be cleaned up."} gitlab # [ 143.980647] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.521Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2fc73c5e2fd51dfbd2d40128","created_at":"2026-10-26T11:17:04.454Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-3ec09794f1ee4e5a","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5fc2468a4837fe7e4ec1305ac4660750","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.461Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2fc73c5e2fd51dfbd2d40128: done: 0.010926 sec","job_status":"done","queue_duration_s":1.049161,"scheduling_latency_s":1.049174,"redis_calls":10,"redis_duration_s":0.00124,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000731,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010926,"completed_at":"2026-10-26T11:17:05.521Z","load_balancing_strategy":"primary","db_duration_s":0.001129,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.021250] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.522Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bb1b294fae73e2e3bb00fc40","created_at":"2026-10-26T11:17:04.454Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-3ec09794f1ee4e5a","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5fc2468a4837fe7e4ec1305ac4660750","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.461Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bb1b294fae73e2e3bb00fc40: start","job_status":"start","queue_duration_s":1.061053,"scheduling_latency_s":1.061067} gitlab # [ 144.024471] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.531Z","message":"No existing merge request to be cleaned up."} gitlab # [ 144.025927] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.536Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bb1b294fae73e2e3bb00fc40","created_at":"2026-10-26T11:17:04.454Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-3ec09794f1ee4e5a","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5fc2468a4837fe7e4ec1305ac4660750","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.461Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bb1b294fae73e2e3bb00fc40: done: 0.01468 sec","job_status":"done","queue_duration_s":1.061053,"scheduling_latency_s":1.061067,"redis_calls":10,"redis_duration_s":0.002111,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001632,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01468,"completed_at":"2026-10-26T11:17:05.536Z","load_balancing_strategy":"primary","db_duration_s":0.005802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.076462] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.537Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fd836ee52f3cbd4fbd9546c9","created_at":"2026-10-26T11:17:04.454Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-3ec09794f1ee4e5a","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5fc2468a4837fe7e4ec1305ac4660750","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.461Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fd836ee52f3cbd4fbd9546c9: start","job_status":"start","queue_duration_s":1.076668,"scheduling_latency_s":1.076682} gitlab # [ 144.077044] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.543Z","message":"No existing merge request to be cleaned up."} gitlab # [ 144.077529] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:05.548Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fd836ee52f3cbd4fbd9546c9","created_at":"2026-10-26T11:17:04.454Z","trace_propagation_headers":{"sentry-trace":"984a8e3a4c234ea69a5f1a8a8d0fddb3-3ec09794f1ee4e5a","baggage":"sentry-trace_id=984a8e3a4c234ea69a5f1a8a8d0fddb3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5fc2468a4837fe7e4ec1305ac4660750","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:04.461Z","job_size_bytes":2,"pid":1604,"sidekiq_tid":"mads","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fd836ee52f3cbd4fbd9546c9: done: 0.01077 sec","job_status":"done","queue_duration_s":1.076668,"scheduling_latency_s":1.076682,"redis_calls":10,"redis_duration_s":0.0013210000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000854,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01077,"completed_at":"2026-10-26T11:17:05.548Z","load_balancing_strategy":"primary","db_duration_s":0.000924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.290650] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1900678705 wd_nsec: 1900677768 gitlab # [ 157.695612] setup-gitlab-start[2201]: W, [2026-10-26T11:17:21.008647 #2201] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 178.732781] postgres[2389]: [2389] ERROR: relation "table_without_models" does not exist gitlab # [ 178.734164] postgres[2389]: [2389] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 181.550137] runuser[2200]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 181.552176] setup-gitlab-start[2182]: + systemctl restart gitlab-sidekiq.service gitlab # [ 181.577215] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 181.578356] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:44.890Z","message":"Shutting down"} gitlab # [ 181.579763] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:44.891Z","message":"Scheduler exiting..."} gitlab # [ 181.581158] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:44.891Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 181.582863] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:44.892Z","message":"Scheduler exiting..."} gitlab # [ 182.079604] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:45.393Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 182.582570] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:45.895Z","message":"Bye!"} gitlab # [ 182.606526] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-10-26T11:17:45.920Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1604,"worker_id":"sidekiq_0","memwd_rss_bytes":956289024,"retry":0} gitlab # [ 184.640736] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 184.641463] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 184.643494] systemd[1]: gitlab-sidekiq.service: Consumed 54.111s CPU time over 1min 53.029s wall clock time, 972.2M memory peak, 4.4M read from disk. gitlab # [ 184.646301] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 184.650488] setup-gitlab-start[2182]: + mkdir -p /var/lib/secrets gitlab # [ 184.655213] setup-gitlab-start[2182]: + echo nixbot-test-token-of-20-chars gitlab # [ 184.657655] setup-gitlab-start[2182]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 184.660223] setup-gitlab-start[2182]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars gitlab # [ 184.887102] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:48 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 189 gitlab # [ 185.580811] gitaly[896]: time="2026-10-26T11:17:48.894Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:58.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:48.894" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.581375] gitaly[896]: time="2026-10-26T11:17:48.895Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:58.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:48.894" grpc.time_ms=0.25 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.720987] gitaly[896]: time="2026-10-26T11:17:49.034Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:59.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.034" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.743358] gitaly[896]: time="2026-10-26T11:17:49.057Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:59.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.034" grpc.time_ms=0.392 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.794959] gitaly[896]: time="2026-10-26T11:17:49.108Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC diskcache=e7f4cfd3-ce47-4ff4-823f-861b09ce0c11 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T11:17:59.031" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.062" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.795849] gitaly[896]: time="2026-10-26T11:17:49.108Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1576 command.oublock=32 command.real_time_ms=23 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T11:17:59.031" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.062" grpc.time_ms=46.664 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.835960] gitaly[896]: time="2026-10-26T11:17:49.149Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:59.118" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.149" pid=896 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 185.836725] gitaly[896]: time="2026-10-26T11:17:49.149Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:59.118" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.149" grpc.time_ms=0.421 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.863238] gitaly[896]: time="2026-10-26T11:17:49.177Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T11:17:59.139" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.169" grpc.time_ms=7.529 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.915140] gitaly[896]: time="2026-10-26T11:17:49.228Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:59.198" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.228" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.929120] gitaly[896]: time="2026-10-26T11:17:49.229Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:59.198" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.228" grpc.time_ms=0.758 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.954924] gitaly[896]: time="2026-10-26T11:17:49.268Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC diskcache=6490e3ea-696d-42b9-bf4f-9fb3a120cd59 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T11:17:59.200" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.231" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.955853] gitaly[896]: time="2026-10-26T11:17:49.268Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1583 command.oublock=32 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T11:17:59.200" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.231" grpc.time_ms=37.307 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.960731] gitaly[896]: time="2026-10-26T11:17:49.274Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:59.243" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.274" pid=896 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 185.961787] gitaly[896]: time="2026-10-26T11:17:49.274Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:59.243" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.274" grpc.time_ms=0.32 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 186.008870] gitaly[896]: time="2026-10-26T11:17:49.322Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T11:17:59.282" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.312" grpc.time_ms=9.803 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 186.044068] gitaly[896]: time="2026-10-26T11:17:49.357Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:17:59.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.357" grpc.time_ms=0.227 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 186.054697] gitaly[896]: time="2026-10-26T11:17:49.368Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T11:17:59.017" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.368" grpc.time_ms=0.19 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 186.438678] gitaly[896]: time="2026-10-26T11:17:49.752Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWK1Y0Z7KRRKNZGK0CSGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T11:17:59.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:49.743" grpc.time_ms=9.2 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 186.798954] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:50 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 1888 gitlab # [ 186.806165] setup-gitlab-start[2439]: {"id":1,"message":null,"error":null} gitlab # [ 187.656463] sidekiq-cluster[2427]: {"severity":"INFO","time":"2026-10-26T11:17:50.953Z","message":"Starting cluster with 1 processes"} gitlab # [ 191.936473] gitaly[896]: time="2026-10-26T11:17:55.249Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWST3BCX0EP9FY3G4EBG9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T11:18:05.214" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:55.244" grpc.time_ms=5.195 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.002803] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:55 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 176 gitlab # [ 192.006111] setup-gitlab-start[2182]: + mkdir -p /tmp/test-flake gitlab # [ 192.009250] setup-gitlab-start[2182]: + cd /tmp/test-flake gitlab # [ 192.009559] setup-gitlab-start[2182]: + git init -b master gitlab # [ 192.034617] setup-gitlab-start[2515]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 192.034935] setup-gitlab-start[2182]: + git config user.name test gitlab # [ 192.038838] setup-gitlab-start[2182]: + git config user.email test@example.com gitlab # [ 192.042043] setup-gitlab-start[2182]: + cat gitlab # [ 192.044720] setup-gitlab-start[2182]: + git add flake.nix gitlab # [ 192.048717] setup-gitlab-start[2182]: + git commit -m 'initial commit' gitlab # [ 192.064693] setup-gitlab-start[2520]: [master (root-commit) 4ec23f5] initial commit gitlab # [ 192.064990] setup-gitlab-start[2520]: 1 file changed, 10 insertions(+) gitlab # [ 192.065484] setup-gitlab-start[2520]: create mode 100644 flake.nix gitlab # [ 192.066177] setup-gitlab-start[2182]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 192.072057] setup-gitlab-start[2182]: + git push -u origin master gitlab # [ 192.171064] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:55 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 73 gitlab # [ 192.335823] gitaly[896]: time="2026-10-26T11:17:55.649Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWT4X7M4G30WPCJDKZ16D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:17:55.640" grpc.time_ms=8.822 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 192.336431] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:55 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 164 gitlab # [ 192.533299] gitaly[896]: time="2026-10-26T11:17:55.847Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T11:18:05.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:55.837" grpc.time_ms=9.492 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.584105] gitaly[896]: time="2026-10-26T11:17:55.897Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-26T11:18:25.084" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-26T11:17:55.885" grpc.time_ms=12.409 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.642815] gitaly[896]: time="2026-10-26T11:17:55.956Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC duration_ms=184ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 192.674466] gitaly[896]: time="2026-10-26T11:17:55.988Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC duration_ms=25ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 192.681178] gitaly[896]: time="2026-10-26T11:17:55.988Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:17:55.771" grpc.time_ms=217.153 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 192.747991] gitaly[896]: time="2026-10-26T11:17:56.061Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:17:56.060" grpc.time_ms=0.852 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 192.796498] gitaly[896]: time="2026-10-26T11:17:56.110Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:17:56.109" grpc.time_ms=0.424 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 192.838648] gitaly[896]: time="2026-10-26T11:17:56.152Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:17:56.151" grpc.time_ms=1.014 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 192.935434] gitaly[896]: time="2026-10-26T11:17:56.249Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T11:18:06.207" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:17:56.238" grpc.time_ms=9.977 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.989286] gitaly[896]: time="2026-10-26T11:17:56.302Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-26T11:18:06.251" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:17:56.282" grpc.time_ms=19.854 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.012812] gitaly[896]: time="2026-10-26T11:17:56.326Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC duration_ms=137ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 193.016157] gitaly[896]: time="2026-10-26T11:17:56.329Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:17:56.188" grpc.time_ms=141.148 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.036973] gitaly[896]: time="2026-10-26T11:17:56.350Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC diskcache=5f9ab4e5-1b5d-46c9-8d19-45944865f705 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:17:55.712" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.046518] gitaly[896]: time="2026-10-26T11:17:56.351Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=219 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13778 command.oublock=32 command.real_time_ms=628 command.spawn_token_fork_ms=1 command.system_time_ms=142 command.user_time_ms=77 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:17:55.712" grpc.time_ms=638.9 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.058779] setup-gitlab-start[2524]: To http://gitlab/root/test-flake.git gitlab # [ 193.059083] setup-gitlab-start[2524]: * [new branch] master -> master gitlab # [ 193.059528] setup-gitlab-start[2524]: branch 'master' set up to track 'origin/master'. gitlab # [ 193.060313] gitlab-workhorse[824]: time="2026-10-26T11:17:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 193.060806] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:56 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 692 gitlab # [ 193.061654] systemd[1]: Finished setup-gitlab.service. gitlab # [ 193.065082] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 194.21 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 194.243452] nixbot[2610]: {"ts": "2026-10-26T11:17:57.556Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 194.274940] nixbot[2610]: {"ts": "2026-10-26T11:17:57.588Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 194.304144] nixbot[2610]: {"ts": "2026-10-26T11:17:57.617Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 194.308117] nixbot[2610]: {"ts": "2026-10-26T11:17:57.621Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 194.312765] nixbot[2610]: {"ts": "2026-10-26T11:17:57.626Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 194.319228] nixbot[2610]: {"ts": "2026-10-26T11:17:57.632Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 194.325326] nixbot[2610]: {"ts": "2026-10-26T11:17:57.638Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 194.329358] nixbot[2610]: {"ts": "2026-10-26T11:17:57.643Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 194.338842] nixbot[2610]: {"ts": "2026-10-26T11:17:57.652Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 194.342267] nixbot[2610]: {"ts": "2026-10-26T11:17:57.655Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 194.349056] nixbot[2610]: {"ts": "2026-10-26T11:17:57.662Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 194.358576] nixbot[2610]: {"ts": "2026-10-26T11:17:57.672Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 194.363353] nixbot[2610]: {"ts": "2026-10-26T11:17:57.677Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 194.369524] nixbot[2610]: {"ts": "2026-10-26T11:17:57.680Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 194.372773] nixbot[2610]: {"ts": "2026-10-26T11:17:57.686Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 194.380575] nixbot[2610]: {"ts": "2026-10-26T11:17:57.694Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 194.383884] nixbot[2610]: {"ts": "2026-10-26T11:17:57.697Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 194.387801] nixbot[2610]: {"ts": "2026-10-26T11:17:57.701Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 194.395527] nixbot[2610]: {"ts": "2026-10-26T11:17:57.709Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 194.398722] nixbot[2610]: {"ts": "2026-10-26T11:17:57.712Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 194.402798] nixbot[2610]: {"ts": "2026-10-26T11:17:57.716Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 194.410742] nixbot[2610]: {"ts": "2026-10-26T11:17:57.724Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 194.413646] nixbot[2610]: {"ts": "2026-10-26T11:17:57.727Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 194.418045] nixbot[2610]: {"ts": "2026-10-26T11:17:57.731Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 194.422382] nixbot[2610]: {"ts": "2026-10-26T11:17:57.736Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 194.427952] nixbot[2610]: {"ts": "2026-10-26T11:17:57.741Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"} gitlab # [ 194.431388] nixbot[2610]: {"ts": "2026-10-26T11:17:57.745Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"} gitlab # [ 194.435238] nixbot[2610]: {"ts": "2026-10-26T11:17:57.748Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"} gitlab # [ 194.439787] nixbot[2610]: {"ts": "2026-10-26T11:17:57.753Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"} gitlab # [ 194.457510] nixbot[2610]: {"ts": "2026-10-26T11:17:57.771Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"} gitlab # [ 194.466248] nixbot[2610]: {"ts": "2026-10-26T11:17:57.779Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"} gitlab # [ 194.469590] nixbot[2610]: {"ts": "2026-10-26T11:17:57.783Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"} gitlab # [ 194.475714] nixbot[2610]: {"ts": "2026-10-26T11:17:57.789Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"} gitlab # [ 194.482124] nixbot[2610]: {"ts": "2026-10-26T11:17:57.795Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"} gitlab # [ 194.487643] nixbot[2610]: {"ts": "2026-10-26T11:17:57.801Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"} gitlab # [ 194.495579] nixbot[2610]: {"ts": "2026-10-26T11:17:57.809Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"} gitlab # [ 194.500316] nixbot[2610]: {"ts": "2026-10-26T11:17:57.814Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"} gitlab # [ 194.505588] nixbot[2610]: {"ts": "2026-10-26T11:17:57.819Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"} gitlab # [ 194.510180] nixbot[2610]: {"ts": "2026-10-26T11:17:57.823Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 38, "migration": "commit_statuses"} gitlab # [ 194.909414] nixbot[2610]: {"ts": "2026-10-26T11:17:58.222Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2610]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"} gitlab # [ 194.910392] nixbot[2610]: {"ts": "2026-10-26T11:17:58.223Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"} gitlab # [ 194.949753] nixbot[2610]: {"ts": "2026-10-26T11:17:58.263Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:49126 - \"GET /health HTTP/1.1\" 200"} gitlab # [ 194.957923] systemd[1]: Started nixbot CI service. gitlab # [ 194.963092] systemd[1]: Reached target Multi-User System. gitlab # [ 194.965482] systemd[1]: Startup finished in 1.196s (kernel) + 3.556s (initrd) + 3min 10.211s (userspace) = 3min 14.965s. gitlab # [ 195.121867] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:58 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 174 gitlab # [ 195.149320] nixbot[2610]: {"ts": "2026-10-26T11:17:58.462Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 195.216341] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 50 gitlab # [ 195.219939] nixbot[2610]: {"ts": "2026-10-26T11:17:58.533Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 195.339531] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 116 gitlab: (finished: waiting for unit nixbot.service, in 2.07 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 195.654903] nixbot[2610]: {"ts": "2026-10-26T11:17:58.967Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:49130 - \"GET /health HTTP/1.1\" 200"} gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 195.737575] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 57 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds) (finished: subtest: project discovered and webhook registered, in 0.09 seconds) subtest: push delivers the webhook gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails' gitlab # [ 195.952581] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:59 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 599 gitlab # [ 196.062841] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 93 gitlab # [ 196.117067] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:59 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 47 gitlab # [ 196.201488] gitaly[896]: time="2026-10-26T11:17:59.514Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWY0EZ31EG0CGVPQG11QR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-26T11:18:29.098" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:17:59.498" grpc.time_ms=15.156 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 196.225386] gitaly[896]: time="2026-10-26T11:17:59.525Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWY0EZ31EG0CGVPQG11QR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:18:29.123" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:17:59.524" grpc.time_ms=0.664 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 196.236741] gitaly[896]: time="2026-10-26T11:17:59.533Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWY0EZ31EG0CGVPQG11QR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-26T11:18:09.177" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:17:59.527" grpc.time_ms=5.53 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 196.249243] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 117 gitlab # [ 196.308462] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 53 gitlab # [ 196.314194] nixbot[2610]: {"ts": "2026-10-26T11:17:59.625Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 196.457156] gitaly[896]: time="2026-10-26T11:17:59.770Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWY8R3XAGFE1VBDAW60W1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:17:59.759" grpc.time_ms=10.893 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 196.485783] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 66 gitlab # [ 196.630640] gitaly[896]: time="2026-10-26T11:17:59.944Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYAWSJ08JHJPW36WZ8S7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:17:59.931" pid=896 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 196.653579] gitaly[896]: time="2026-10-26T11:17:59.944Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYAWSJ08JHJPW36WZ8S7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:17:59.931" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 196.681368] gitlab-workhorse[824]: time="2026-10-26T11:17:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 196.684862] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:17:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 172 gitlab # [ 196.688503] gitaly[896]: time="2026-10-26T11:17:59.944Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYAWSJ08JHJPW36WZ8S7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:17:59.931" grpc.time_ms=12.961 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 196.714567] gitaly[896]: time="2026-10-26T11:18:00.028Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYGCEV5ZWQ29TDQ636GY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.015" pid=896 remote_ip="2001:db8:1::1" request_sha=4faac94f9c20d3e23b651321e7af12a2b8dfd4c8 response_bytes=224 span.kind=server system=grpc gitlab # [ 196.724309] gitaly[896]: time="2026-10-26T11:18:00.028Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYGCEV5ZWQ29TDQ636GY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.015" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 196.724955] gitlab-workhorse[824]: time="2026-10-26T11:18:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=224 gitlab # [ 196.725599] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 81 gitlab # [ 196.726080] gitaly[896]: time="2026-10-26T11:18:00.028Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYGCEV5ZWQ29TDQ636GY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.015" grpc.time_ms=13.189 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 196.835322] gitaly[896]: time="2026-10-26T11:18:00.149Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWYN00NWFANKV3J98KZBY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.139" grpc.time_ms=9.392 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 196.859387] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:00 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 53 gitlab # [ 196.882626] gitaly[896]: time="2026-10-26T11:18:00.196Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYPQSFK7BY8GSNNTGTNW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.186" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 196.883306] gitaly[896]: time="2026-10-26T11:18:00.196Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYPQSFK7BY8GSNNTGTNW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.186" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 196.884438] gitlab-workhorse[824]: time="2026-10-26T11:18:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 196.886819] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 45 gitlab # [ 196.888511] gitaly[896]: time="2026-10-26T11:18:00.196Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYPQSFK7BY8GSNNTGTNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.186" grpc.time_ms=10.334 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 196.990175] gitaly[896]: time="2026-10-26T11:18:00.302Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWYT2992D3BBWP3DN2VJQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.293" grpc.time_ms=8.275 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 196.991850] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:00 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 46 gitlab # [ 197.090016] gitaly[896]: time="2026-10-26T11:18:00.403Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYVJ2RGK6GETEJHMXGVJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.389" pid=896 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 197.090651] gitaly[896]: time="2026-10-26T11:18:00.403Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1160 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYVJ2RGK6GETEJHMXGVJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.389" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.091772] gitaly[896]: time="2026-10-26T11:18:00.404Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1160 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWYVJ2RGK6GETEJHMXGVJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:00.389" grpc.time_ms=14.444 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.092908] gitlab-workhorse[824]: time="2026-10-26T11:18:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 197.093974] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 97 gitlab # [ 197.220983] gitaly[896]: time="2026-10-26T11:18:00.534Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:18:30.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:00.533" grpc.time_ms=0.76 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.277514] gitaly[896]: time="2026-10-26T11:18:00.591Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-26T11:18:30.084" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:00.585" grpc.time_ms=5.965 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.293948] gitaly[896]: time="2026-10-26T11:18:00.607Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:10.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:00.602" grpc.time_ms=5.271 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.309445] gitaly[896]: time="2026-10-26T11:18:00.623Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:10.016" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:00.616" grpc.time_ms=6.601 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.359090] gitaly[896]: time="2026-10-26T11:18:00.672Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T11:18:10.072" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:00.672" grpc.time_ms=0.189 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.378848] gitaly[896]: time="2026-10-26T11:18:00.692Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T11:18:10.087" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:00.687" grpc.time_ms=4.681 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.406037] gitaly[896]: time="2026-10-26T11:18:00.719Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:00.719" grpc.time_ms=0.26 pid=896 span.kind=server system=grpc gitlab # [ 197.429968] gitaly[896]: time="2026-10-26T11:18:00.743Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:00.743" grpc.time_ms=0.235 pid=896 span.kind=server system=grpc gitlab # [ 197.446544] gitaly[896]: time="2026-10-26T11:18:00.760Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 diskcache=fe8cb506-ec5a-4c5c-ad47-268ef91b43a9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T11:18:10.095" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:00.695" pid=896 ref=refs/keep-around/4ec23f597ee106a6723179ddbb62437ba6c8aef7 remote_ip="2001:db8:1::1" revision=4ec23f597ee106a6723179ddbb62437ba6c8aef7 span.kind=server system=grpc username=root gitlab # [ 197.457202] gitaly[896]: time="2026-10-26T11:18:00.760Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=38 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5182 command.oublock=8 command.real_time_ms=57 command.spawn_token_fork_ms=0 command.system_time_ms=23 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T11:18:10.095" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:00.695" grpc.time_ms=64.632 pid=896 ref=refs/keep-around/4ec23f597ee106a6723179ddbb62437ba6c8aef7 remote_ip="2001:db8:1::1" revision=4ec23f597ee106a6723179ddbb62437ba6c8aef7 span.kind=server system=grpc username=root gitlab # [ 197.471145] gitaly[896]: time="2026-10-26T11:18:00.763Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:18:30.263" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:00.763" grpc.time_ms=0.234 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.551089] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4ec23f597ee106a6723179ddbb62437ba6c8aef7 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 374 gitlab # [ 197.564193] nixbot[2610]: {"ts": "2026-10-26T11:18:00.877Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4ec23f597ee1-0"} gitlab # [ 197.754769] nixbot[2610]: {"ts": "2026-10-26T11:18:01.068Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4ec23f597ee1-0", "argv0": "bwrap"} gitlab # [ 197.853851] systemd[1]: Started Nix Daemon. gitlab # [ 197.922360] nix-daemon[2777]: accepted connection from pid 2765, user nixbot gitlab # [ 202.671376] nix-daemon[2777]: accepted connection from pid 2819, user nixbot gitlab # [ 202.686119] nix-daemon[2777]: accepted connection from pid 2765, user nixbot gitlab # [ 207.699803] nix-daemon[2777]: accepted connection from pid 2765, user nixbot gitlab # [ 207.784388] nix-daemon[2777]: accepted connection from pid 2868, user nixbot gitlab # [ 207.832970] gitaly[896]: time="2026-10-26T11:18:11.146Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYX9CE5F5JP86770WJXN2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:18:41.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:11.144" grpc.time_ms=0.969 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.867117] gitaly[896]: time="2026-10-26T11:18:11.180Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYX9CE5F5JP86770WJXN2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:21.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:11.175" grpc.time_ms=5.588 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.913892] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4ec23f597ee106a6723179ddbb62437ba6c8aef7 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 139 gitlab # [ 207.962136] gitaly[896]: time="2026-10-26T11:18:11.275Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYX9H9JYZZ0ZD0KSB3907C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:18:41.174" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:11.275" grpc.time_ms=0.553 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.015687] gitaly[896]: time="2026-10-26T11:18:11.329Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYX9H9JYZZ0ZD0KSB3907C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:21.152" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:11.322" grpc.time_ms=6.899 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.048065] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4ec23f597ee106a6723179ddbb62437ba6c8aef7 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 119 gitlab # [ 211.862957] sidekiq-cluster[2486]: 2026-10-26T11:18:15.175Z pid=2486 tid=xsu INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2486, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>435863552} gitlab # [ 212.027457] sidekiq-cluster[2486]: W, [2026-10-26T11:18:15.341019 #2486] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 212.063554] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:15.377Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 212.338605] nix-daemon[2777]: accepted connection from pid 2942, user nixbot gitlab # [ 212.422955] gitaly[896]: time="2026-10-26T11:18:15.736Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYXDW00NFCMG65Z2VHPB4P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:18:45.334" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:15.735" grpc.time_ms=0.803 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.553461] gitaly[896]: time="2026-10-26T11:18:15.867Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYXDW00NFCMG65Z2VHPB4P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:25.115" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:15.855" grpc.time_ms=11.045 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.629305] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4ec23f597ee106a6723179ddbb62437ba6c8aef7 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 261 gitlab # [ 212.808775] nixbot[2610]: {"ts": "2026-10-26T11:18:16.121Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "4ec23f597ee106a6723179ddbb62437ba6c8aef7", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []} gitlab # [ 212.880660] gitaly[896]: time="2026-10-26T11:18:16.194Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYXEAQB9D65GB7X5D262SS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:16.184" grpc.time_ms=8.711 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.881485] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 42 gitlab # [ 212.947841] gitaly[896]: time="2026-10-26T11:18:16.261Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYXECT4F8HC1EK4X354F0Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:16.252" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 212.948775] gitaly[896]: time="2026-10-26T11:18:16.261Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYXECT4F8HC1EK4X354F0Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:16.252" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.986066] gitaly[896]: time="2026-10-26T11:18:16.299Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYXECT4F8HC1EK4X354F0Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:16.252" grpc.time_ms=47.478 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.986822] gitlab-workhorse[824]: time="2026-10-26T11:18:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 212.987680] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 81 gitlab # [ 213.073547] gitaly[896]: time="2026-10-26T11:18:16.386Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYXEGDV7AMEF9JKCPZZ5J8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:16.379" grpc.time_ms=7.704 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.073822] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 53 gitlab # [ 213.142406] gitaly[896]: time="2026-10-26T11:18:16.456Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYXEJXZGNWXVF510GCC1CP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:16.448" pid=896 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 213.142648] gitaly[896]: time="2026-10-26T11:18:16.456Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYXEJXZGNWXVF510GCC1CP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:16.448" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.143790] gitaly[896]: time="2026-10-26T11:18:16.456Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYXEJXZGNWXVF510GCC1CP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:16.448" grpc.time_ms=7.632 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.195064] gitlab-workhorse[824]: time="2026-10-26T11:18:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 213.195787] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 95 gitlab # [ 213.706066] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:17.019Z","message":"GitLab reliable fetch activated!"} gitlab # [ 213.706827] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:17.019Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 232.774712] postgres[3150]: [3150] ERROR: relation "table_without_models" does not exist gitlab # [ 232.775303] postgres[3150]: [3150] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 235.115782] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:38.428Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 235.117288] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:38.431Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 235.119147] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:38.431Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 235.120223] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:38.431Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 235.121392] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:38.434Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 40.42 seconds) gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 236.263431] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 47 gitlab # [ 236.368765] gitaly[896]: time="2026-10-26T11:18:39.681Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY56Y7S9FYYV490VH2TJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:39.671" grpc.time_ms=10.096 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.369638] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 100 gitlab # [ 236.393374] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:39.706Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"bcd93fc6d5256fcc35c81c6a","created_at":"2026-10-26T11:17:49.188Z","trace_propagation_headers":{"sentry-trace":"e7ac8c38c2ca429da8602b59612dac4f-6a4919d77fbc4701","baggage":"sentry-trace_id=e7ac8c38c2ca429da8602b59612dac4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWK1Y0Z7KRRKNZGK0CSGC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:49.212Z","job_size_bytes":2,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-bcd93fc6d5256fcc35c81c6a: start","job_status":"start","queue_duration_s":50.494224,"scheduling_latency_s":50.49426} gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 236.513690] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:39.827Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"bcd93fc6d5256fcc35c81c6a","created_at":"2026-10-26T11:17:49.188Z","trace_propagation_headers":{"sentry-trace":"e7ac8c38c2ca429da8602b59612dac4f-6a4919d77fbc4701","baggage":"sentry-trace_id=e7ac8c38c2ca429da8602b59612dac4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWK1Y0Z7KRRKNZGK0CSGC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:49.212Z","job_size_bytes":2,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-bcd93fc6d5256fcc35c81c6a: done: 0.121051 sec","job_status":"done","queue_duration_s":50.494224,"scheduling_latency_s":50.49426,"redis_calls":23,"redis_duration_s":0.004065,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.002493,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00062,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.059872693,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.121051,"completed_at":"2026-10-26T11:18:39.827Z","load_balancing_strategy":"primary","db_duration_s":0.036498,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.514458] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:39.828Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f7635a868803b15e6d82134a","created_at":"2026-10-26T11:17:49.220Z","trace_propagation_headers":{"sentry-trace":"e7ac8c38c2ca429da8602b59612dac4f-6a4919d77fbc4701","baggage":"sentry-trace_id=e7ac8c38c2ca429da8602b59612dac4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWK1Y0Z7KRRKNZGK0CSGC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:49.224Z","job_size_bytes":2,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f7635a868803b15e6d82134a: start","job_status":"start","queue_duration_s":50.60384,"scheduling_latency_s":50.603854} gitlab # [ 236.579419] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:39.893Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f7635a868803b15e6d82134a","created_at":"2026-10-26T11:17:49.220Z","trace_propagation_headers":{"sentry-trace":"e7ac8c38c2ca429da8602b59612dac4f-6a4919d77fbc4701","baggage":"sentry-trace_id=e7ac8c38c2ca429da8602b59612dac4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWK1Y0Z7KRRKNZGK0CSGC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:49.224Z","job_size_bytes":2,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f7635a868803b15e6d82134a: done: 0.064834 sec","job_status":"done","queue_duration_s":50.60384,"scheduling_latency_s":50.603854,"redis_calls":14,"redis_duration_s":0.0025830000000000002,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000373,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001327,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.050001326,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.064834,"completed_at":"2026-10-26T11:18:39.892Z","load_balancing_strategy":"primary","db_duration_s":0.014214,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.592110] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:39.894Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2d26745b91a7f130ea0524f3","created_at":"2026-10-26T11:17:49.669Z","trace_propagation_headers":{"sentry-trace":"e7ac8c38c2ca429da8602b59612dac4f-6a4919d77fbc4701","baggage":"sentry-trace_id=e7ac8c38c2ca429da8602b59612dac4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWK1Y0Z7KRRKNZGK0CSGC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:49.674Z","job_size_bytes":5,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2d26745b91a7f130ea0524f3: start","job_status":"start","queue_duration_s":50.219526,"scheduling_latency_s":50.219539} gitlab # [ 236.689513] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:40.002Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2d26745b91a7f130ea0524f3","created_at":"2026-10-26T11:17:49.669Z","trace_propagation_headers":{"sentry-trace":"e7ac8c38c2ca429da8602b59612dac4f-6a4919d77fbc4701","baggage":"sentry-trace_id=e7ac8c38c2ca429da8602b59612dac4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWK1Y0Z7KRRKNZGK0CSGC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:49.674Z","job_size_bytes":5,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2d26745b91a7f130ea0524f3: done: 0.108657 sec","job_status":"done","queue_duration_s":50.219526,"scheduling_latency_s":50.219539,"redis_calls":12,"redis_duration_s":0.0031490000000000003,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000641,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002086,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000271543,"duration_s":0.108657,"completed_at":"2026-10-26T11:18:40.002Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020679,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.691829] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:40.004Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"57266c0b726ece8e5f213461","created_at":"2026-10-26T11:17:49.696Z","trace_propagation_headers":{"sentry-trace":"e7ac8c38c2ca429da8602b59612dac4f-6a4919d77fbc4701","baggage":"sentry-trace_id=e7ac8c38c2ca429da8602b59612dac4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWK1Y0Z7KRRKNZGK0CSGC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:49.699Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-57266c0b726ece8e5f213461: start","job_status":"start","queue_duration_s":50.304855,"scheduling_latency_s":50.304869} gitlab # [ 236.748488] gitaly[896]: time="2026-10-26T11:18:40.062Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-26T11:19:10.056" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-26T11:18:40.056" grpc.time_ms=5.273 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 236.757771] gitaly[896]: time="2026-10-26T11:18:40.071Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 duration_ms=68ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 236.782187] gitaly[896]: time="2026-10-26T11:18:40.095Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 duration_ms=23ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 236.787235] gitaly[896]: time="2026-10-26T11:18:40.096Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:40.001" grpc.time_ms=94.259 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.804983] gitaly[896]: time="2026-10-26T11:18:40.118Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:40.118" grpc.time_ms=0.376 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.824973] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:40.138Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"57266c0b726ece8e5f213461","created_at":"2026-10-26T11:17:49.696Z","trace_propagation_headers":{"sentry-trace":"e7ac8c38c2ca429da8602b59612dac4f-6a4919d77fbc4701","baggage":"sentry-trace_id=e7ac8c38c2ca429da8602b59612dac4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWK1Y0Z7KRRKNZGK0CSGC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:49.699Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-57266c0b726ece8e5f213461: done: 0.134205 sec","job_status":"done","queue_duration_s":50.304855,"scheduling_latency_s":50.304869,"redis_calls":11,"redis_duration_s":0.003447,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000767,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000363,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.109,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.109,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300038,"duration_s":0.134205,"completed_at":"2026-10-26T11:18:40.138Z","load_balancing_strategy":"primary","db_duration_s":0.048605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.826796] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:40.139Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"6674d1d83f8092dd6b45cff8","created_at":"2026-10-26T11:17:49.701Z","trace_propagation_headers":{"sentry-trace":"e7ac8c38c2ca429da8602b59612dac4f-6a4919d77fbc4701","baggage":"sentry-trace_id=e7ac8c38c2ca429da8602b59612dac4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWK1Y0Z7KRRKNZGK0CSGC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:49.704Z","job_size_bytes":89,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-6674d1d83f8092dd6b45cff8: start","job_status":"start","queue_duration_s":50.435347,"scheduling_latency_s":50.435387} gitlab # [ 236.848869] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:40.162Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"6674d1d83f8092dd6b45cff8","created_at":"2026-10-26T11:17:49.701Z","trace_propagation_headers":{"sentry-trace":"e7ac8c38c2ca429da8602b59612dac4f-6a4919d77fbc4701","baggage":"sentry-trace_id=e7ac8c38c2ca429da8602b59612dac4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWK1Y0Z7KRRKNZGK0CSGC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-26T11:17:49.704Z","job_size_bytes":89,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-6674d1d83f8092dd6b45cff8: done: 0.022577 sec","job_status":"done","queue_duration_s":50.435347,"scheduling_latency_s":50.435387,"redis_calls":11,"redis_duration_s":0.001511,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000362,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209245,"duration_s":0.022577,"completed_at":"2026-10-26T11:18:40.162Z","load_balancing_strategy":"primary","db_duration_s":0.002654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.900756] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:40.163Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 4ec23f597ee106a6723179ddbb62437ba6c8aef7 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7da2de7924f289161fb92c62","created_at":"2026-10-26T11:17:56.221Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-fe7f72eec45f47b3","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:56.225Z","job_size_bytes":185,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7da2de7924f289161fb92c62: start","job_status":"start","queue_duration_s":43.938324,"scheduling_latency_s":43.938336} gitlab # [ 236.901495] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:40.172Z","message":"changes: \"0000000000000000000000000000000000000000 4ec23f597ee106a6723179ddbb62437ba6c8aef7 refs/heads/master\\n\""} gitlab # [ 236.912768] gitaly[896]: time="2026-10-26T11:18:40.226Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:50.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:40.221" grpc.time_ms=5.202 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 236.922192] gitaly[896]: time="2026-10-26T11:18:40.236Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T11:18:50.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:40.231" grpc.time_ms=4.764 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 236.956566] gitaly[896]: time="2026-10-26T11:18:40.270Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-26T11:18:50.043" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:40.263" grpc.time_ms=6.45 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 236.980633] gitaly[896]: time="2026-10-26T11:18:40.294Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:40.294" grpc.time_ms=0.205 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.987177] gitaly[896]: time="2026-10-26T11:18:40.298Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:40.294" grpc.time_ms=4.113 pid=896 span.kind=server system=grpc gitlab # [ 237.004578] gitaly[896]: time="2026-10-26T11:18:40.318Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:40.318" grpc.time_ms=0.307 pid=896 span.kind=server system=grpc gitlab # [ 237.013669] gitaly[896]: time="2026-10-26T11:18:40.327Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC diskcache=6abcb45a-3d4e-4ff9-8071-5fb44850e143 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T11:18:50.056" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:40.276" pid=896 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 237.014450] gitaly[896]: time="2026-10-26T11:18:40.327Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=43 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4934 command.oublock=8 command.real_time_ms=43 command.spawn_token_fork_ms=0 command.system_time_ms=28 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T11:18:50.056" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:40.276" grpc.time_ms=50.849 pid=896 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 237.025551] gitaly[896]: time="2026-10-26T11:18:40.339Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T11:18:50.118" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:40.339" grpc.time_ms=0.096 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.036155] gitaly[896]: time="2026-10-26T11:18:40.349Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=936 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-26T11:18:50.122" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:40.342" grpc.time_ms=7.52 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.060619] gitaly[896]: time="2026-10-26T11:18:40.374Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:40.374" grpc.time_ms=0.302 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 237.092930] gitaly[896]: time="2026-10-26T11:18:40.406Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-26T11:19:10.002" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:40.402" grpc.time_ms=3.786 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.110395] gitaly[896]: time="2026-10-26T11:18:40.424Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T11:18:50.203" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:40.423" grpc.time_ms=0.181 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.115104] gitaly[896]: time="2026-10-26T11:18:40.428Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-26T11:18:50.205" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-26T11:18:40.425" grpc.time_ms=3.422 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.120511] gitaly[896]: time="2026-10-26T11:18:40.434Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 duration_ms=32ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 237.121114] gitaly[896]: time="2026-10-26T11:18:40.434Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:40.401" grpc.time_ms=33.167 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 237.150725] gitaly[896]: time="2026-10-26T11:18:40.464Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 diskcache=b261560c-197a-4f85-aac6-8618a0a87648 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:39.816" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 237.151671] gitaly[896]: time="2026-10-26T11:18:40.464Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=253 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13585 command.oublock=32 command.real_time_ms=639 command.spawn_token_fork_ms=0 command.system_time_ms=180 command.user_time_ms=73 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:39.816" grpc.time_ms=648.395 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 237.156989] gitaly[896]: time="2026-10-26T11:18:40.470Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:50.245" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:40.465" grpc.time_ms=5.348 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.166159] gitaly[896]: time="2026-10-26T11:18:40.479Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:50.254" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:40.475" grpc.time_ms=4.746 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.181488] gitaly[896]: time="2026-10-26T11:18:40.495Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=959 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-26T11:19:10.088" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:40.488" grpc.time_ms=7.049 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.208043] gitlab-workhorse[824]: time="2026-10-26T11:18:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 237.208550] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:40 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 768 gitlab # To http://gitlab/root/test-flake.git gitlab # 4ec23f5..7fd835d master -> master gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.07 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b' gitlab # [ 237.291072] nixbot[2610]: {"ts": "2026-10-26T11:18:40.603Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:60734 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b HTTP/1.1\" 200"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', in 0.06 seconds) gitlab # [ 237.512888] gitaly[896]: time="2026-10-26T11:18:40.825Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-26T11:18:50.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:40.824" grpc.time_ms=0.999 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.570432] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:40.883Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 4ec23f597ee106a6723179ddbb62437ba6c8aef7 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7da2de7924f289161fb92c62","created_at":"2026-10-26T11:17:56.221Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-fe7f72eec45f47b3","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:17:56.225Z","job_size_bytes":185,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7da2de7924f289161fb92c62: done: 0.719742 sec","job_status":"done","queue_duration_s":43.938324,"scheduling_latency_s":43.938336,"gitaly_calls":13,"gitaly_duration_s":0.185532,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.058948,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.002782,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.004435,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001262,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00275,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.010795,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.036924,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.155,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.172,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.455423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000331886,"exclusive_lock_hold_duration_s":0.050232082,"duration_s":0.719742,"completed_at":"2026-10-26T11:18:40.883Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.066545,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 237.648101] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:40.961Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c3ca5af82058435e7b88b9d8","created_at":"2026-10-26T11:18:00.768Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-e3b9c2c93229428d","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:00.774Z","job_size_bytes":65,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c3ca5af82058435e7b88b9d8: start","job_status":"start","queue_duration_s":40.187298,"scheduling_latency_s":40.18733} gitlab # [ 237.724246] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:41.037Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c3ca5af82058435e7b88b9d8","created_at":"2026-10-26T11:18:00.768Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-e3b9c2c93229428d","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:00.774Z","job_size_bytes":65,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c3ca5af82058435e7b88b9d8: done: 0.076292 sec","job_status":"done","queue_duration_s":40.187298,"scheduling_latency_s":40.18733,"redis_calls":16,"redis_duration_s":0.0038929999999999998,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002075,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001339,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000292216,"duration_s":0.076292,"completed_at":"2026-10-26T11:18:41.037Z","load_balancing_strategy":"primary","db_duration_s":0.021175,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 237.792378] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:41.105Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c217736ee265f137d312d269","created_at":"2026-10-26T11:18:00.775Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-e3b9c2c93229428d","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:00.777Z","job_size_bytes":65,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c217736ee265f137d312d269: start","job_status":"start","queue_duration_s":40.32777,"scheduling_latency_s":40.327806} gitlab # [ 237.908443] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:41.221Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c217736ee265f137d312d269","created_at":"2026-10-26T11:18:00.775Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-e3b9c2c93229428d","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:00.777Z","job_size_bytes":65,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c217736ee265f137d312d269: done: 0.115805 sec","job_status":"done","queue_duration_s":40.32777,"scheduling_latency_s":40.327806,"redis_calls":21,"redis_duration_s":0.006137,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002472,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001924,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000479111,"duration_s":0.115805,"completed_at":"2026-10-26T11:18:41.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029163,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.910636] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:41.223Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"acc56d795057ca3bb533d53d","created_at":"2026-10-26T11:18:00.847Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-e3b9c2c93229428d","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:00.851Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-acc56d795057ca3bb533d53d: start","job_status":"start","queue_duration_s":40.371964,"scheduling_latency_s":40.371994} gitlab # [ 238.111385] gitaly[896]: time="2026-10-26T11:18:41.425Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:41.424" grpc.time_ms=0.411 pid=896 span.kind=server system=grpc gitlab # [ 238.155553] gitaly[896]: time="2026-10-26T11:18:41.469Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:41.468" grpc.time_ms=0.639 pid=896 span.kind=server system=grpc gitlab # [ 238.198540] gitaly[896]: time="2026-10-26T11:18:41.512Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:41.511" grpc.time_ms=0.285 pid=896 span.kind=server system=grpc gitlab # [ 238.226908] gitaly[896]: time="2026-10-26T11:18:41.540Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 diskcache=c1ab3bd6-b139-4423-ac6c-c1dd9bc92c84 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:11.085" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:41.386" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.227755] gitaly[896]: time="2026-10-26T11:18:41.541Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=127 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7666 command.oublock=0 command.real_time_ms=144 command.spawn_token_fork_ms=0 command.system_time_ms=84 command.user_time_ms=43 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:11.085" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:41.386" grpc.time_ms=154.545 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b' gitlab # [ 238.334250] nixbot[2610]: {"ts": "2026-10-26T11:18:41.647Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:60736 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b HTTP/1.1\" 200"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', in 0.04 seconds) gitlab # [ 238.383882] gitaly[896]: time="2026-10-26T11:18:41.697Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T11:19:11.296" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:41.696" grpc.time_ms=1.119 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.439648] gitaly[896]: time="2026-10-26T11:18:41.753Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWZ18X6XAWQ9F9N5Z8P92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:11.351" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:41.752" grpc.time_ms=1.04 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.455893] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:41.768Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"acc56d795057ca3bb533d53d","created_at":"2026-10-26T11:18:00.847Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-e3b9c2c93229428d","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:00.851Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2486,"job_status":"rescheduled","message":"PipelineProcessWorker JID-acc56d795057ca3bb533d53d: rescheduled"} gitlab # [ 238.467424] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:41.780Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"acc56d795057ca3bb533d53d","created_at":"2026-10-26T11:18:00.847Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-e3b9c2c93229428d","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:00.851Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-acc56d795057ca3bb533d53d: done: 0.556482 sec","job_status":"done","queue_duration_s":40.371964,"scheduling_latency_s":40.371994,"gitaly_calls":3,"gitaly_duration_s":0.190271,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.025454,"redis_read_bytes":460,"redis_write_bytes":29295,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001205,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001115,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.009488,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003726,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15582,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005473,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000573,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000513,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002156,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.017,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.02,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.223036,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.488803744,"duration_s":0.556482,"completed_at":"2026-10-26T11:18:41.780Z","load_balancing_strategy":"primary","db_duration_s":0.12266,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.500334] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:41.782Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"21d561d8597eb2d6118232e1","created_at":"2026-10-26T11:18:40.237Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-721c85d77e764a4b","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.250Z","job_size_bytes":46,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-21d561d8597eb2d6118232e1: start","job_status":"start","queue_duration_s":1.532128,"scheduling_latency_s":1.532153} gitlab # [ 238.549350] gitaly[896]: time="2026-10-26T11:18:41.862Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-26T17:18:41.824" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:41.824" grpc.time_ms=2.184 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.575391] gitaly[896]: time="2026-10-26T11:18:41.889Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-26T11:19:11.482" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:41.882" grpc.time_ms=6.283 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.618754] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:41.931Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"21d561d8597eb2d6118232e1","created_at":"2026-10-26T11:18:40.237Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-721c85d77e764a4b","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.250Z","job_size_bytes":46,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-21d561d8597eb2d6118232e1: done: 0.149408 sec","job_status":"done","queue_duration_s":1.532128,"scheduling_latency_s":1.532153,"gitaly_calls":2,"gitaly_duration_s":0.073054,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008354,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.0019,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000758,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001908,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002975,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000474641,"duration_s":0.149408,"completed_at":"2026-10-26T11:18:41.931Z","load_balancing_strategy":"primary","db_duration_s":0.013903,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.639333] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:41.933Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5dd167e27b1884735d46c010","created_at":"2026-10-26T11:18:40.258Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-721c85d77e764a4b","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.261Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5dd167e27b1884735d46c010: start","job_status":"start","queue_duration_s":1.67229,"scheduling_latency_s":1.672314} gitlab # [ 238.700567] gitaly[896]: time="2026-10-26T11:18:42.014Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC diskcache=e1ffbde2-daed-491f-b9ee-b1f4503cba7c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-26T17:18:41.951" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:41.952" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.710065] gitaly[896]: time="2026-10-26T11:18:42.014Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1287 command.oublock=0 command.real_time_ms=62 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-26T17:18:41.951" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:41.952" grpc.time_ms=62.204 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.743389] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:42.056Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5dd167e27b1884735d46c010","created_at":"2026-10-26T11:18:40.258Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-721c85d77e764a4b","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.261Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5dd167e27b1884735d46c010: done: 0.123042 sec","job_status":"done","queue_duration_s":1.67229,"scheduling_latency_s":1.672314,"gitaly_calls":1,"gitaly_duration_s":0.064736,"redis_calls":15,"redis_duration_s":0.003705,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000405,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001354,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000661,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001285,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.021,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.101387746,"duration_s":0.123042,"completed_at":"2026-10-26T11:18:42.056Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.786632] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:42.099Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"7a20ce9cf8fe294a770bd6b1","created_at":"2026-10-26T11:18:40.335Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-721c85d77e764a4b","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.337Z","job_size_bytes":23,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-7a20ce9cf8fe294a770bd6b1: start","job_status":"start","queue_duration_s":1.76269,"scheduling_latency_s":1.762735} gitlab # [ 238.835634] gitaly[896]: time="2026-10-26T11:18:42.149Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-26T11:19:12.038" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:42.139" grpc.time_ms=10.099 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.860143] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:42.172Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"7a20ce9cf8fe294a770bd6b1","created_at":"2026-10-26T11:18:40.335Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-721c85d77e764a4b","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.337Z","job_size_bytes":23,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-7a20ce9cf8fe294a770bd6b1: done: 0.072815 sec","job_status":"done","queue_duration_s":1.76269,"scheduling_latency_s":1.762735,"gitaly_calls":1,"gitaly_duration_s":0.024289,"redis_calls":16,"redis_duration_s":0.004962,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000406,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001473,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002209,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.072815,"completed_at":"2026-10-26T11:18:42.172Z","load_balancing_strategy":"primary","db_duration_s":0.004039,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.862111] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:42.175Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","4ec23f597ee106a6723179ddbb62437ba6c8aef7 7fd835d0d8fb588dcac6b74e98bb43aac4b6397b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5e869f3bd684b9b7ad7cf13e","created_at":"2026-10-26T11:18:40.423Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-08f8479136b84747","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.425Z","job_size_bytes":185,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5e869f3bd684b9b7ad7cf13e: start","job_status":"start","queue_duration_s":1.750484,"scheduling_latency_s":1.750516} gitlab # [ 238.876799] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:42.188Z","message":"changes: \"4ec23f597ee106a6723179ddbb62437ba6c8aef7 7fd835d0d8fb588dcac6b74e98bb43aac4b6397b refs/heads/master\\n\""} gitlab # [ 238.902693] gitaly[896]: time="2026-10-26T11:18:42.216Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:52.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:42.207" grpc.time_ms=8.59 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.921145] gitaly[896]: time="2026-10-26T11:18:42.234Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T11:18:52.024" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:42.224" grpc.time_ms=10.265 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.947477] gitaly[896]: time="2026-10-26T11:18:42.261Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-26T11:18:52.052" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:42.253" grpc.time_ms=8.172 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.959133] gitaly[896]: time="2026-10-26T11:18:42.272Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-26T11:19:12.164" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:42.264" grpc.time_ms=8.411 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.986033] gitaly[896]: time="2026-10-26T11:18:42.299Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-26T11:18:52.094" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-26T11:18:42.294" grpc.time_ms=5.393 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.005549] gitaly[896]: time="2026-10-26T11:18:42.319Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:52.109" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:42.309" grpc.time_ms=9.472 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.087761] gitaly[896]: time="2026-10-26T11:18:42.401Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-26T11:18:52.200" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:42.400" grpc.time_ms=1.037 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.110304] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:42.418Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","4ec23f597ee106a6723179ddbb62437ba6c8aef7 7fd835d0d8fb588dcac6b74e98bb43aac4b6397b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5e869f3bd684b9b7ad7cf13e","created_at":"2026-10-26T11:18:40.423Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-08f8479136b84747","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.425Z","job_size_bytes":185,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5e869f3bd684b9b7ad7cf13e: done: 0.242759 sec","job_status":"done","queue_duration_s":1.750484,"scheduling_latency_s":1.750516,"gitaly_calls":7,"gitaly_duration_s":0.079841,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.019708,"redis_read_bytes":352,"redis_write_bytes":12744,"redis_cache_calls":9,"redis_cache_duration_s":0.002154,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":8,"redis_queues_duration_s":0.00128,"redis_queues_read_bytes":12,"redis_queues_write_bytes":6767,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002752,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007269,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.006253,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.02,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.02,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.135726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000716012,"exclusive_lock_hold_duration_s":0.020595076,"duration_s":0.242759,"completed_at":"2026-10-26T11:18:42.418Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020719,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 239.150068] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:42.420Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3388ab7955e4b0ad8bf8a26d","created_at":"2026-10-26T11:18:40.688Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-721c85d77e764a4b","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5fea9e043ceb2dd7a41cee9787230d3a9bc4a582c7898afcffce6faf1afa0171","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.694Z","job_size_bytes":467,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3388ab7955e4b0ad8bf8a26d: start","job_status":"start","queue_duration_s":1.725935,"scheduling_latency_s":1.725961} gitlab # [ 239.150909] gitaly[896]: time="2026-10-26T11:18:42.454Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:12.353" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:42.453" grpc.time_ms=0.556 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.151666] gitaly[896]: time="2026-10-26T11:18:42.461Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T11:18:52.256" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:42.456" grpc.time_ms=4.857 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.224110] gitaly[896]: time="2026-10-26T11:18:42.537Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T11:19:12.436" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:42.536" grpc.time_ms=0.985 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.240797] gitaly[896]: time="2026-10-26T11:18:42.554Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=100 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-26T11:19:12.451" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:42.552" grpc.time_ms=2.29 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b' gitlab # [ 239.329302] gitaly[896]: time="2026-10-26T11:18:42.643Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:52.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:42.632" grpc.time_ms=10.163 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.371139] nixbot[2610]: {"ts": "2026-10-26T11:18:42.684Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:60738 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b HTTP/1.1\" 200"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', in 0.04 seconds) gitlab # [ 239.782900] gitaly[896]: time="2026-10-26T11:18:43.095Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-26T11:19:13.078" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:43.079" grpc.time_ms=16.598 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.798371] gitaly[896]: time="2026-10-26T11:18:43.112Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYWTABYQ51AT1EEJ4ZZNWC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-26T11:19:13.098" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:43.098" grpc.time_ms=13.4 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.831828] sidekiq-cluster[2486]: {"severity":"WARN","time":"2026-10-26T11:18:43.144Z","class":"CreatePipelineWorker","correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"4ec23f597ee106a6723179ddbb62437ba6c8aef7","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4ec23f597ee106a6723179ddbb62437ba6c8aef7","ref":"refs/heads/master"},"retry":0} gitlab # [ 239.839422] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3388ab7955e4b0ad8bf8a26d","created_at":"2026-10-26T11:18:40.688Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-721c85d77e764a4b","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5fea9e043ceb2dd7a41cee9787230d3a9bc4a582c7898afcffce6faf1afa0171","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.694Z","job_size_bytes":467,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3388ab7955e4b0ad8bf8a26d: done: 0.731474 sec","job_status":"done","queue_duration_s":1.725935,"scheduling_latency_s":1.725961,"gitaly_calls":7,"gitaly_duration_s":0.116268,"redis_calls":51,"redis_duration_s":0.008151,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000649,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003414,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002043,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.573513,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000327974,"duration_s":0.731474,"completed_at":"2026-10-26T11:18:43.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043423,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 239.884788] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.154Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"8ec5b541-640c-401a-96fe-3db8903ad06b\"}"],"class":"WebHookWorker","jid":"e8e202d32fce83c7bb6f4c23","created_at":"2026-10-26T11:18:40.801Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-721c85d77e764a4b","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9103aad0e848b4b3d7b7932605d531c1991a521c9ad107c036093aeb3e0fa89f","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.806Z","job_size_bytes":1751,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e8e202d32fce83c7bb6f4c23: start","job_status":"start","queue_duration_s":2.348309,"scheduling_latency_s":2.348323} gitlab # [ 239.928421] nixbot[2610]: {"ts": "2026-10-26T11:18:43.242Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "5b0e0dbd-09a1-445e-94cd-b687a8af9a3e", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "4ec23f597ee106a6723179ddbb62437ba6c8aef7", "pr": null} gitlab # [ 239.935578] nixbot[2610]: {"ts": "2026-10-26T11:18:43.249Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:60754 - \"POST /webhooks/gitlab HTTP/1.1\" 202"} gitlab # [ 239.949649] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.262Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"8ec5b541-640c-401a-96fe-3db8903ad06b\"}"],"class":"WebHookWorker","jid":"e8e202d32fce83c7bb6f4c23","created_at":"2026-10-26T11:18:40.801Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-721c85d77e764a4b","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9103aad0e848b4b3d7b7932605d531c1991a521c9ad107c036093aeb3e0fa89f","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:40.806Z","job_size_bytes":1751,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e8e202d32fce83c7bb6f4c23: done: 0.108034 sec","job_status":"done","queue_duration_s":2.348309,"scheduling_latency_s":2.348323,"redis_calls":19,"redis_duration_s":0.00257,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000612,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000214,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00049,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04001542099999256,"cpu_s":0.059175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000302553,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.108034,"completed_at":"2026-10-26T11:18:43.262Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.953965] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e80411a05f97b0faf802b71f","created_at":"2026-10-26T11:18:41.374Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.378Z","job_size_bytes":23,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e80411a05f97b0faf802b71f: start","job_status":"start","queue_duration_s":1.886186,"scheduling_latency_s":1.8862} gitlab # [ 240.061493] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.374Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e80411a05f97b0faf802b71f","created_at":"2026-10-26T11:18:41.374Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.378Z","job_size_bytes":23,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e80411a05f97b0faf802b71f: done: 0.110129 sec","job_status":"done","queue_duration_s":1.886186,"scheduling_latency_s":1.8862,"redis_calls":10,"redis_duration_s":0.001912,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000525,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001064,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210362,"duration_s":0.110129,"completed_at":"2026-10-26T11:18:43.374Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03741,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 240.089715] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.376Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ddfa792d61695bb492d591c2","created_at":"2026-10-26T11:18:41.546Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.549Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ddfa792d61695bb492d591c2: start","job_status":"start","queue_duration_s":1.826008,"scheduling_latency_s":1.826022} gitlab # [ 240.090499] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.400Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ddfa792d61695bb492d591c2","created_at":"2026-10-26T11:18:41.546Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.549Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ddfa792d61695bb492d591c2: done: 0.024296 sec","job_status":"done","queue_duration_s":1.826008,"scheduling_latency_s":1.826022,"redis_calls":10,"redis_duration_s":0.001542,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00034,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000237181,"duration_s":0.024296,"completed_at":"2026-10-26T11:18:43.400Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.155649] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 53 gitlab # [ 240.156277] gitaly[896]: time="2026-10-26T11:18:43.383Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY8W2YY4GB39YNR66AMKM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:43.377" grpc.time_ms=5.868 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.156940] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.401Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c04981c9a05c055f0cddd78e","created_at":"2026-10-26T11:18:41.559Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.564Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c04981c9a05c055f0cddd78e: start","job_status":"start","queue_duration_s":1.837164,"scheduling_latency_s":1.837175} gitlab # [ 240.157550] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.426Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c04981c9a05c055f0cddd78e","created_at":"2026-10-26T11:18:41.559Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.564Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c04981c9a05c055f0cddd78e: done: 0.024923 sec","job_status":"done","queue_duration_s":1.837164,"scheduling_latency_s":1.837175,"redis_calls":10,"redis_duration_s":0.00406,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000383,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003435,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000328812,"duration_s":0.024923,"completed_at":"2026-10-26T11:18:43.426Z","load_balancing_strategy":"primary","db_duration_s":0.003384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.209170] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.427Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"118968b012861e50d4ba9a28","created_at":"2026-10-26T11:18:41.635Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.639Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-118968b012861e50d4ba9a28: start","job_status":"start","queue_duration_s":1.788238,"scheduling_latency_s":1.78825} gitlab # [ 240.209901] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.450Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"118968b012861e50d4ba9a28","created_at":"2026-10-26T11:18:41.635Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.639Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-118968b012861e50d4ba9a28: done: 0.023606 sec","job_status":"done","queue_duration_s":1.788238,"scheduling_latency_s":1.78825,"redis_calls":13,"redis_duration_s":0.0023,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00034,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191924,"duration_s":0.023606,"completed_at":"2026-10-26T11:18:43.450Z","load_balancing_strategy":"primary","db_duration_s":0.003214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.249829] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.451Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e11fa148b27a72d26201907b","created_at":"2026-10-26T11:18:41.639Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.645Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e11fa148b27a72d26201907b: start","job_status":"start","queue_duration_s":1.806223,"scheduling_latency_s":1.806235} gitlab # [ 240.288721] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e11fa148b27a72d26201907b","created_at":"2026-10-26T11:18:41.639Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.645Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e11fa148b27a72d26201907b: done: 0.019139 sec","job_status":"done","queue_duration_s":1.806223,"scheduling_latency_s":1.806235,"redis_calls":10,"redis_duration_s":0.001196,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195276,"duration_s":0.019139,"completed_at":"2026-10-26T11:18:43.470Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.332512] gitaly[896]: time="2026-10-26T11:18:43.632Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY8XRXC0ZHHW79AWPAPPG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:43.626" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 240.333234] gitlab-workhorse[824]: time="2026-10-26T11:18:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 240.333625] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 248 gitlab # [ 240.334187] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.471Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2c00148241e123bc25d59533","created_at":"2026-10-26T11:18:41.646Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.655Z","job_size_bytes":19,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2c00148241e123bc25d59533: start","job_status":"start","queue_duration_s":1.815888,"scheduling_latency_s":1.8159} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b' gitlab # [ 240.334790] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.492Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2c00148241e123bc25d59533","created_at":"2026-10-26T11:18:41.646Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.655Z","job_size_bytes":19,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2c00148241e123bc25d59533: done: 0.020481 sec","job_status":"done","queue_duration_s":1.815888,"scheduling_latency_s":1.8159,"redis_calls":11,"redis_duration_s":0.001453,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216507,"duration_s":0.020481,"completed_at":"2026-10-26T11:18:43.492Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.363793] gitaly[896]: time="2026-10-26T11:18:43.632Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY8XRXC0ZHHW79AWPAPPG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:43.626" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.404787] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.493Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f4d456e7c1e5896b06e66270","created_at":"2026-10-26T11:18:41.658Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.661Z","job_size_bytes":66,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f4d456e7c1e5896b06e66270: start","job_status":"start","queue_duration_s":1.832234,"scheduling_latency_s":1.832247} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', in 0.06 seconds) gitlab # [ 240.405586] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.513Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f4d456e7c1e5896b06e66270","created_at":"2026-10-26T11:18:41.658Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.661Z","job_size_bytes":66,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f4d456e7c1e5896b06e66270: done: 0.020191 sec","job_status":"done","queue_duration_s":1.832234,"scheduling_latency_s":1.832247,"redis_calls":10,"redis_duration_s":0.001215,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198349,"duration_s":0.020191,"completed_at":"2026-10-26T11:18:43.513Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.464242] gitlab-workhorse[824]: time="2026-10-26T11:18:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=337 gitlab # [ 240.464824] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 51 gitlab # [ 240.465489] gitaly[896]: time="2026-10-26T11:18:43.633Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY8XRXC0ZHHW79AWPAPPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:43.626" grpc.time_ms=6.659 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.466145] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.514Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c174dc5f9dfec18a7ed2faa8","created_at":"2026-10-26T11:18:41.661Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.665Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c174dc5f9dfec18a7ed2faa8: start","job_status":"start","queue_duration_s":1.848612,"scheduling_latency_s":1.848624} gitlab # [ 240.466719] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.536Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c174dc5f9dfec18a7ed2faa8","created_at":"2026-10-26T11:18:41.661Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.665Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c174dc5f9dfec18a7ed2faa8: done: 0.022103 sec","job_status":"done","queue_duration_s":1.848612,"scheduling_latency_s":1.848624,"redis_calls":10,"redis_duration_s":0.001112,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000217,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189131,"duration_s":0.022103,"completed_at":"2026-10-26T11:18:43.536Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.533072] nixbot[2610]: {"ts": "2026-10-26T11:18:43.746Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:60768 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b HTTP/1.1\" 200"} gitlab # [ 240.533804] nixbot[2610]: {"ts": "2026-10-26T11:18:43.746Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 240.534425] nixbot[2610]: {"ts": "2026-10-26T11:18:43.748Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "4ec23f597ee106a6723179ddbb62437ba6c8aef7"} gitlab # [ 240.534933] gitaly[896]: time="2026-10-26T11:18:43.685Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY95J75EJCNWY84N1PAKE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:43.674" pid=896 remote_ip="2001:db8:1::1" request_sha=43bfa08ba1d481c1bf6f7fa225275d071093679e response_bytes=337 span.kind=server system=grpc gitlab # [ 240.535542] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.537Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"d71090f34344b5a0711e4fe0","created_at":"2026-10-26T11:18:41.671Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.674Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d71090f34344b5a0711e4fe0: start","job_status":"start","queue_duration_s":1.863163,"scheduling_latency_s":1.863176} gitlab # [ 240.536474] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.558Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"d71090f34344b5a0711e4fe0","created_at":"2026-10-26T11:18:41.671Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.674Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d71090f34344b5a0711e4fe0: done: 0.020933 sec","job_status":"done","queue_duration_s":1.863163,"scheduling_latency_s":1.863176,"redis_calls":10,"redis_duration_s":0.001185,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193879,"duration_s":0.020933,"completed_at":"2026-10-26T11:18:43.558Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.571573] gitaly[896]: time="2026-10-26T11:18:43.685Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY95J75EJCNWY84N1PAKE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:43.674" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.613695] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.559Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a9023dc25b93384eeb714b24","created_at":"2026-10-26T11:18:41.674Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.677Z","job_size_bytes":6,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a9023dc25b93384eeb714b24: start","job_status":"start","queue_duration_s":1.881909,"scheduling_latency_s":1.881922} gitlab # [ 240.614497] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.572Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a9023dc25b93384eeb714b24","created_at":"2026-10-26T11:18:41.674Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.677Z","job_size_bytes":6,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a9023dc25b93384eeb714b24: done: 0.013237 sec","job_status":"done","queue_duration_s":1.881909,"scheduling_latency_s":1.881922,"redis_calls":10,"redis_duration_s":0.001173,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189689,"duration_s":0.013237,"completed_at":"2026-10-26T11:18:43.572Z","load_balancing_strategy":"primary","db_duration_s":0.001202,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.667775] gitaly[896]: time="2026-10-26T11:18:43.686Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY95J75EJCNWY84N1PAKE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:43.674" grpc.time_ms=11.752 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.668433] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4ec23f597ee106a6723179ddbb62437ba6c8aef7 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 200 gitlab # [ 240.668927] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.573Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d8f623224e5ed745e5dbc191","created_at":"2026-10-26T11:18:41.677Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.680Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d8f623224e5ed745e5dbc191: start","job_status":"start","queue_duration_s":1.893063,"scheduling_latency_s":1.893075} gitlab # [ 240.669667] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.593Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d8f623224e5ed745e5dbc191","created_at":"2026-10-26T11:18:41.677Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.680Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d8f623224e5ed745e5dbc191: done: 0.019847 sec","job_status":"done","queue_duration_s":1.893063,"scheduling_latency_s":1.893075,"redis_calls":10,"redis_duration_s":0.001162,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000224,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000188851,"duration_s":0.019847,"completed_at":"2026-10-26T11:18:43.593Z","load_balancing_strategy":"primary","db_duration_s":0.003587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.708983] gitaly[896]: time="2026-10-26T11:18:43.743Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 diskcache=39311675-323b-4bfd-a96b-3098f0c8ab0a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-26T17:18:43.732" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:43.733" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.712162] gitaly[896]: time="2026-10-26T11:18:43.743Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-26T17:18:43.732" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:43.733" grpc.time_ms=9.998 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.724297] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.593Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5ef48c3bcdbaf59fdb396128","created_at":"2026-10-26T11:18:41.684Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.687Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5ef48c3bcdbaf59fdb396128: start","job_status":"start","queue_duration_s":1.906328,"scheduling_latency_s":1.90634} gitlab # [ 240.775557] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.630Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5ef48c3bcdbaf59fdb396128","created_at":"2026-10-26T11:18:41.684Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.687Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5ef48c3bcdbaf59fdb396128: done: 0.036908 sec","job_status":"done","queue_duration_s":1.906328,"scheduling_latency_s":1.90634,"redis_calls":14,"redis_duration_s":0.002536,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000221,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000707,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277689,"duration_s":0.036908,"completed_at":"2026-10-26T11:18:43.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007207,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.777571] gitaly[896]: time="2026-10-26T11:18:43.768Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:13.667" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:43.768" grpc.time_ms=0.419 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.826590] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4ec23f597ee106a6723179ddbb62437ba6c8aef7 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 102 gitlab # [ 240.829171] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.631Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"426e2d23fa6d33fd79c1aaed","created_at":"2026-10-26T11:18:41.769Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.772Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-426e2d23fa6d33fd79c1aaed: start","job_status":"start","queue_duration_s":1.859824,"scheduling_latency_s":1.859838} gitlab # [ 240.829930] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.649Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"426e2d23fa6d33fd79c1aaed","created_at":"2026-10-26T11:18:41.769Z","trace_propagation_headers":{"sentry-trace":"5d1d5700e6384d709694ee10f9e412a7-de6b096aed1e44cc","baggage":"sentry-trace_id=5d1d5700e6384d709694ee10f9e412a7,sentry-release=Unknown"},"correlation_id":"01M5VYWZ18X6XAWQ9F9N5Z8P92","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.772Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-426e2d23fa6d33fd79c1aaed: done: 0.018082 sec","job_status":"done","queue_duration_s":1.859824,"scheduling_latency_s":1.859838,"redis_calls":8,"redis_duration_s":0.001932,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001295,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000637,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018082,"completed_at":"2026-10-26T11:18:43.649Z","load_balancing_strategy":"primary","db_duration_s":0.002857,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 240.876403] gitaly[896]: time="2026-10-26T11:18:43.775Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T11:18:53.139" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:43.770" grpc.time_ms=5.481 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.877461] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"54580ee2ead4484c50776731","created_at":"2026-10-26T11:18:41.910Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-143aaa4049814bef","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.917Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-54580ee2ead4484c50776731: start","job_status":"start","queue_duration_s":1.733476,"scheduling_latency_s":1.733491} gitlab # [ 240.878105] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.687Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"54580ee2ead4484c50776731","created_at":"2026-10-26T11:18:41.910Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-143aaa4049814bef","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:41.917Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-54580ee2ead4484c50776731: done: 0.03694 sec","job_status":"done","queue_duration_s":1.733476,"scheduling_latency_s":1.733491,"redis_calls":19,"redis_duration_s":0.005277,"redis_read_bytes":21,"redis_write_bytes":4288,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003182,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000486,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2259,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008920687,"duration_s":0.03694,"completed_at":"2026-10-26T11:18:43.687Z","load_balancing_strategy":"primary","db_duration_s":0.005844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.938357] gitaly[896]: time="2026-10-26T11:18:43.797Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T11:19:13.696" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:43.797" grpc.time_ms=0.44 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.938987] nixbot[2610]: {"ts": "2026-10-26T11:18:44.231Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "1f3c67ef-2b5d-4c30-abcd-f9d698447840", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "7fd835d0d8fb588dcac6b74e98bb43aac4b6397b", "pr": null} gitlab # [ 240.939621] nixbot[2610]: {"ts": "2026-10-26T11:18:44.233Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:60772 - \"POST /webhooks/gitlab HTTP/1.1\" 202"} gitlab # [ 240.940125] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.690Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"86ab533790caf377d6cb2a02","created_at":"2026-10-26T11:18:42.238Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-8b27cadbe1b14ff9","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:42.240Z","job_size_bytes":46,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-86ab533790caf377d6cb2a02: start","job_status":"start","queue_duration_s":1.449822,"scheduling_latency_s":1.449841} gitlab # [ 240.940776] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.705Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"86ab533790caf377d6cb2a02","created_at":"2026-10-26T11:18:42.238Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-8b27cadbe1b14ff9","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:42.240Z","job_size_bytes":46,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-86ab533790caf377d6cb2a02: done: 0.014226 sec","job_status":"done","queue_duration_s":1.449822,"scheduling_latency_s":1.449841,"redis_calls":9,"redis_duration_s":0.001467,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000156,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014226,"completed_at":"2026-10-26T11:18:43.704Z","load_balancing_strategy":"primary","db_duration_s":0.001224,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.000848] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4ec23f597ee106a6723179ddbb62437ba6c8aef7 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 121 gitlab # [ 241.002939] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 55 gitlab # [ 241.003623] gitaly[896]: time="2026-10-26T11:18:43.804Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=12 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-26T11:19:13.699" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:43.800" grpc.time_ms=3.942 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.004284] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.713Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"1fd90bed0ad556f953c8ea74","created_at":"2026-10-26T11:18:42.248Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-8b27cadbe1b14ff9","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:42.250Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-1fd90bed0ad556f953c8ea74: start","job_status":"start","queue_duration_s":1.46274,"scheduling_latency_s":1.462761} gitlab # [ 241.011645] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.753Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"1fd90bed0ad556f953c8ea74","created_at":"2026-10-26T11:18:42.248Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-8b27cadbe1b14ff9","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:42.250Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-1fd90bed0ad556f953c8ea74: done: 0.040338 sec","job_status":"done","queue_duration_s":1.46274,"scheduling_latency_s":1.462761,"gitaly_calls":1,"gitaly_duration_s":0.011587,"redis_calls":12,"redis_duration_s":0.005883,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000408,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000863,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.023819508,"duration_s":0.040338,"completed_at":"2026-10-26T11:18:43.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.068274] gitaly[896]: time="2026-10-26T11:18:43.824Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:53.189" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:43.819" grpc.time_ms=5.115 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.068919] gitlab-workhorse[824]: time="2026-10-26T11:18:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 241.069507] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 44 gitlab # [ 241.069985] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:43.754Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"dbb1a093f2d8c08554121ba0","created_at":"2026-10-26T11:18:42.370Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-8b27cadbe1b14ff9","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a84e8860f0bb508aaf1792a7317d9a4000183532594ebdc89407764aae8137fc","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:42.373Z","job_size_bytes":467,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-dbb1a093f2d8c08554121ba0: start","job_status":"start","queue_duration_s":1.380935,"scheduling_latency_s":1.380947} gitlab # [ 241.085133] sidekiq-cluster[2486]: {"severity":"WARN","time":"2026-10-26T11:18:44.204Z","class":"CreatePipelineWorker","correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"4ec23f597ee106a6723179ddbb62437ba6c8aef7","after":"7fd835d0d8fb588dcac6b74e98bb43aac4b6397b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"7fd835d0d8fb588dcac6b74e98bb43aac4b6397b","ref":"refs/heads/master"},"retry":0} gitlab # [ 241.092446] gitaly[896]: time="2026-10-26T11:18:43.870Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY99ER77QK3C3Y0RGJ6JD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:13.869" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:43.869" grpc.time_ms=0.83 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.101624] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 51 gitlab # [ 241.102460] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.209Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"dbb1a093f2d8c08554121ba0","created_at":"2026-10-26T11:18:42.370Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-8b27cadbe1b14ff9","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a84e8860f0bb508aaf1792a7317d9a4000183532594ebdc89407764aae8137fc","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:42.373Z","job_size_bytes":467,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-dbb1a093f2d8c08554121ba0: done: 0.455103 sec","job_status":"done","queue_duration_s":1.380935,"scheduling_latency_s":1.380947,"gitaly_calls":7,"gitaly_duration_s":0.047519,"redis_calls":33,"redis_duration_s":0.0051660000000000005,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000923,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002866,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000672,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.390146,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.455103,"completed_at":"2026-10-26T11:18:44.209Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01322,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.178783] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.211Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"6363ed48-8d5b-45ef-b026-6081cda22029\"}"],"class":"WebHookWorker","jid":"bf84c24462c068ad3d270013","created_at":"2026-10-26T11:18:42.388Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-8b27cadbe1b14ff9","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5457c0c7d7fef0c5d89ce6fb50d5620b549e17bf7c4e80276612bd671e849f5b","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:42.391Z","job_size_bytes":1749,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-bf84c24462c068ad3d270013: start","job_status":"start","queue_duration_s":1.820009,"scheduling_latency_s":1.820029} gitlab # [ 241.179754] gitaly[896]: time="2026-10-26T11:18:43.924Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY99ER77QK3C3Y0RGJ6JD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:53.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:43.918" grpc.time_ms=5.642 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.181166] gitlab-workhorse[824]: time="2026-10-26T11:18:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 241.182192] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 69 gitlab # [ 241.183163] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.241Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"6363ed48-8d5b-45ef-b026-6081cda22029\"}"],"class":"WebHookWorker","jid":"bf84c24462c068ad3d270013","created_at":"2026-10-26T11:18:42.388Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-8b27cadbe1b14ff9","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5457c0c7d7fef0c5d89ce6fb50d5620b549e17bf7c4e80276612bd671e849f5b","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:42.391Z","job_size_bytes":1749,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-bf84c24462c068ad3d270013: done: 0.030086 sec","job_status":"done","queue_duration_s":1.820009,"scheduling_latency_s":1.820029,"redis_calls":14,"redis_duration_s":0.002271,"redis_read_bytes":25,"redis_write_bytes":4682,"redis_queues_calls":2,"redis_queues_duration_s":0.000239,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3726,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000625,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.004691938000007667,"cpu_s":0.019429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.030086,"completed_at":"2026-10-26T11:18:44.241Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001466,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.241108] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.242Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e8e202d32fce83c7bb6f4c23"],"class":"WebHooks::LogExecutionWorker","jid":"596b3b183b53e41d925a2c12","created_at":"2026-10-26T11:18:43.252Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-1335fdcfe5fd446f","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8d45da4570879a8fc77be8c8e0c24ba2df8c59dc6683eccfaca784e1d02287d5","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:43.257Z","job_size_bytes":2593,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-596b3b183b53e41d925a2c12: start","job_status":"start","queue_duration_s":0.984657,"scheduling_latency_s":0.984675} gitlab # [ 241.241840] gitaly[896]: time="2026-10-26T11:18:44.002Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY9FWMCZESCGQBG0G53Z2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:14.100" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:44.001" grpc.time_ms=0.525 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.246060] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 55 gitlab # [ 241.247891] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.280Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e8e202d32fce83c7bb6f4c23"],"class":"WebHooks::LogExecutionWorker","jid":"596b3b183b53e41d925a2c12","created_at":"2026-10-26T11:18:43.252Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-1335fdcfe5fd446f","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8d45da4570879a8fc77be8c8e0c24ba2df8c59dc6683eccfaca784e1d02287d5","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:43.257Z","job_size_bytes":2593,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-596b3b183b53e41d925a2c12: done: 0.038492 sec","job_status":"done","queue_duration_s":0.984657,"scheduling_latency_s":0.984675,"redis_calls":10,"redis_duration_s":0.001575,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000323504,"duration_s":0.038492,"completed_at":"2026-10-26T11:18:44.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.325652] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.281Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"d0c78d56f4de8404013ccc30","created_at":"2026-10-26T11:18:43.674Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-f5a7d1e7fb1e40de","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:43.680Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-d0c78d56f4de8404013ccc30: start","job_status":"start","queue_duration_s":0.601795,"scheduling_latency_s":0.601808} gitlab # [ 241.326502] gitaly[896]: time="2026-10-26T11:18:44.030Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY9FWMCZESCGQBG0G53Z2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:54.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:44.023" grpc.time_ms=6.81 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.327115] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 73 gitlab # [ 241.327575] gitlab-workhorse[824]: time="2026-10-26T11:18:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 241.328181] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 57 gitlab # [ 241.328718] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.354Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"d0c78d56f4de8404013ccc30","created_at":"2026-10-26T11:18:43.674Z","trace_propagation_headers":{"sentry-trace":"ffad56f2a84d424ba975d976228a5786-f5a7d1e7fb1e40de","baggage":"sentry-trace_id=ffad56f2a84d424ba975d976228a5786,sentry-release=Unknown"},"correlation_id":"01M5VYWTABYQ51AT1EEJ4ZZNWC","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:43.680Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-d0c78d56f4de8404013ccc30: done: 0.072913 sec","job_status":"done","queue_duration_s":0.601795,"scheduling_latency_s":0.601808,"redis_calls":11,"redis_duration_s":0.002319,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001708,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000309257,"duration_s":0.072913,"completed_at":"2026-10-26T11:18:44.354Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.373899] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.356Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"426d5f4cd5237a3841b88b97","created_at":"2026-10-26T11:18:43.946Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-967a8d49663748ae","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:43.948Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-426d5f4cd5237a3841b88b97: start","job_status":"start","queue_duration_s":0.40732,"scheduling_latency_s":0.407335} gitlab # [ 241.374892] gitaly[896]: time="2026-10-26T11:18:44.111Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY9KA5V40T8JCF3TRARG3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:14.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:44.110" grpc.time_ms=0.506 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.386226] gitlab-workhorse[824]: time="2026-10-26T11:18:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 241.387644] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 55 gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b' gitlab # [ 241.426762] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.582Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"426d5f4cd5237a3841b88b97","created_at":"2026-10-26T11:18:43.946Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-967a8d49663748ae","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:43.948Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2486,"job_status":"rescheduled","message":"PipelineProcessWorker JID-426d5f4cd5237a3841b88b97: rescheduled"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', in 0.04 seconds) gitlab # [ 241.427599] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.588Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"426d5f4cd5237a3841b88b97","created_at":"2026-10-26T11:18:43.946Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-967a8d49663748ae","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:43.948Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-426d5f4cd5237a3841b88b97: done: 0.232557 sec","job_status":"done","queue_duration_s":0.40732,"scheduling_latency_s":0.407335,"gitaly_calls":3,"gitaly_duration_s":0.088082,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.021732,"redis_read_bytes":147,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001381,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001632,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003197,"redis_queues_read_bytes":25,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.008423,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000201,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000352,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.005165,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089972,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.199099327,"duration_s":0.232557,"completed_at":"2026-10-26T11:18:44.588Z","load_balancing_strategy":"primary","db_duration_s":0.030434,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.473899] gitaly[896]: time="2026-10-26T11:18:44.152Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY9KA5V40T8JCF3TRARG3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:54.115" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:44.145" grpc.time_ms=7.11 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.474715] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 50 gitlab # [ 241.475734] gitlab-workhorse[824]: time="2026-10-26T11:18:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 241.476786] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 49 gitlab # [ 241.477494] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.591Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","bf84c24462c068ad3d270013"],"class":"WebHooks::LogExecutionWorker","jid":"349cc99c5ca51af2a6affccf","created_at":"2026-10-26T11:18:44.234Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-44ac02200cd84d3d","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d96dca877b7f8002130db28b6c05a2af188d9f86c31e4c746941d03e501213e4","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.236Z","job_size_bytes":2592,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-349cc99c5ca51af2a6affccf: start","job_status":"start","queue_duration_s":0.354812,"scheduling_latency_s":0.354828} gitlab # [ 241.479815] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.617Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","bf84c24462c068ad3d270013"],"class":"WebHooks::LogExecutionWorker","jid":"349cc99c5ca51af2a6affccf","created_at":"2026-10-26T11:18:44.234Z","trace_propagation_headers":{"sentry-trace":"5e01f061f50141d5aae3f09b87d2afca-44ac02200cd84d3d","baggage":"sentry-trace_id=5e01f061f50141d5aae3f09b87d2afca,sentry-release=Unknown"},"correlation_id":"01M5VYY5C9GYTH7PSHMXBNJWG4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d96dca877b7f8002130db28b6c05a2af188d9f86c31e4c746941d03e501213e4","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.236Z","job_size_bytes":2592,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-349cc99c5ca51af2a6affccf: done: 0.02621 sec","job_status":"done","queue_duration_s":0.354812,"scheduling_latency_s":0.354828,"redis_calls":7,"redis_duration_s":0.001871,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02621,"completed_at":"2026-10-26T11:18:44.617Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.533666] gitaly[896]: time="2026-10-26T11:18:44.181Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-26T11:19:14.071" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:44.172" grpc.time_ms=9.044 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.535165] nixbot[2610]: {"ts": "2026-10-26T11:18:44.791Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:60788 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b HTTP/1.1\" 200"} gitlab # [ 241.536055] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.619Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"57924e67e71f5e41b9e05c68","created_at":"2026-10-26T11:18:44.411Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.414Z","job_size_bytes":23,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-57924e67e71f5e41b9e05c68: start","job_status":"start","queue_duration_s":0.204523,"scheduling_latency_s":0.204537} gitlab # [ 241.548187] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.657Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"57924e67e71f5e41b9e05c68","created_at":"2026-10-26T11:18:44.411Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.414Z","job_size_bytes":23,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-57924e67e71f5e41b9e05c68: done: 0.038502 sec","job_status":"done","queue_duration_s":0.204523,"scheduling_latency_s":0.204537,"redis_calls":7,"redis_duration_s":0.0030280000000000003,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001309,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038502,"completed_at":"2026-10-26T11:18:44.657Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008503,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.589112] gitaly[896]: time="2026-10-26T11:18:44.192Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY5C9GYTH7PSHMXBNJWG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-26T11:19:14.083" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:44.183" grpc.time_ms=8.902 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.599195] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.658Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"fb2e7a8de3150fcea64b714e","created_at":"2026-10-26T11:18:44.504Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.506Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-fb2e7a8de3150fcea64b714e: start","job_status":"start","queue_duration_s":0.152023,"scheduling_latency_s":0.152039} gitlab # [ 241.615204] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.680Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"fb2e7a8de3150fcea64b714e","created_at":"2026-10-26T11:18:44.504Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.506Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-fb2e7a8de3150fcea64b714e: done: 0.021331 sec","job_status":"done","queue_duration_s":0.152023,"scheduling_latency_s":0.152039,"redis_calls":7,"redis_duration_s":0.001207,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021331,"completed_at":"2026-10-26T11:18:44.680Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.667036] gitaly[896]: time="2026-10-26T11:18:44.276Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY9QX9G3091HYMVC8Y7XJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.260" grpc.time_ms=15.996 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 241.667692] gitaly[896]: time="2026-10-26T11:18:44.322Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY9SPTMC4EFT4KEA0RQ8P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.310" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 241.673982] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.681Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"45069eb5dd2ac93299c0a274","created_at":"2026-10-26T11:18:44.515Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.516Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-45069eb5dd2ac93299c0a274: start","job_status":"start","queue_duration_s":0.164345,"scheduling_latency_s":0.164364} gitlab # [ 241.688222] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.706Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"45069eb5dd2ac93299c0a274","created_at":"2026-10-26T11:18:44.515Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.516Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-45069eb5dd2ac93299c0a274: done: 0.024855 sec","job_status":"done","queue_duration_s":0.164345,"scheduling_latency_s":0.164364,"redis_calls":7,"redis_duration_s":0.003476,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024855,"completed_at":"2026-10-26T11:18:44.705Z","load_balancing_strategy":"primary","db_duration_s":0.003955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.753294] gitaly[896]: time="2026-10-26T11:18:44.322Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY9SPTMC4EFT4KEA0RQ8P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.310" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 241.753907] nixbot[2610]: {"ts": "2026-10-26T11:18:45.015Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-7fd835d0d8fb-6"} gitlab # [ 241.754519] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.707Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7acec9f557f58cdb075490e5","created_at":"2026-10-26T11:18:44.521Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.523Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7acec9f557f58cdb075490e5: start","job_status":"start","queue_duration_s":0.184131,"scheduling_latency_s":0.18415} gitlab # [ 241.756622] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7acec9f557f58cdb075490e5","created_at":"2026-10-26T11:18:44.521Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.523Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7acec9f557f58cdb075490e5: done: 0.022443 sec","job_status":"done","queue_duration_s":0.184131,"scheduling_latency_s":0.18415,"redis_calls":10,"redis_duration_s":0.003393,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000915,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022443,"completed_at":"2026-10-26T11:18:44.729Z","load_balancing_strategy":"primary","db_duration_s":0.002768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.808623] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 203 gitlab # [ 241.809493] gitaly[896]: time="2026-10-26T11:18:44.322Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY9SPTMC4EFT4KEA0RQ8P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.310" grpc.time_ms=11.831 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 241.810143] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.731Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"485a05ef64026bc492b74767","created_at":"2026-10-26T11:18:44.523Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.524Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-485a05ef64026bc492b74767: start","job_status":"start","queue_duration_s":0.206148,"scheduling_latency_s":0.206164} gitlab # [ 241.821865] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.753Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"485a05ef64026bc492b74767","created_at":"2026-10-26T11:18:44.523Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.524Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-485a05ef64026bc492b74767: done: 0.021976 sec","job_status":"done","queue_duration_s":0.206148,"scheduling_latency_s":0.206164,"redis_calls":7,"redis_duration_s":0.00131,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021976,"completed_at":"2026-10-26T11:18:44.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006061,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.860325] nixbot[2610]: {"ts": "2026-10-26T11:18:45.099Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-7fd835d0d8fb-6", "argv0": "bwrap"} gitlab # [ 241.862405] gitaly[896]: time="2026-10-26T11:18:44.404Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY9W1CRXWCBBE970H6CSD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.397" grpc.time_ms=6.697 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 241.874186] gitaly[896]: time="2026-10-26T11:18:44.450Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYY99ER77QK3C3Y0RGJ6JD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:44.449" grpc.time_ms=0.317 pid=896 span.kind=server system=grpc gitlab # [ 241.914362] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.754Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3e0c78c37fe1823a44b45b9a","created_at":"2026-10-26T11:18:44.526Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.528Z","job_size_bytes":19,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3e0c78c37fe1823a44b45b9a: start","job_status":"start","queue_duration_s":0.225971,"scheduling_latency_s":0.225985} gitlab # [ 241.914996] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.776Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3e0c78c37fe1823a44b45b9a","created_at":"2026-10-26T11:18:44.526Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.528Z","job_size_bytes":19,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3e0c78c37fe1823a44b45b9a: done: 0.02267 sec","job_status":"done","queue_duration_s":0.225971,"scheduling_latency_s":0.225985,"redis_calls":8,"redis_duration_s":0.0014719999999999998,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001169,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02267,"completed_at":"2026-10-26T11:18:44.776Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.934147] gitaly[896]: time="2026-10-26T11:18:44.469Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYY99ER77QK3C3Y0RGJ6JD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:44.468" grpc.time_ms=0.396 pid=896 span.kind=server system=grpc gitlab # [ 241.942466] gitaly[896]: time="2026-10-26T11:18:44.475Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY9XP88E5CNQBQ5Z33BV1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.464" pid=896 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 241.951671] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.780Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3286f008f00ad81249bf516a","created_at":"2026-10-26T11:18:44.528Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.529Z","job_size_bytes":66,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3286f008f00ad81249bf516a: start","job_status":"start","queue_duration_s":0.250783,"scheduling_latency_s":0.250801} gitlab # [ 241.991669] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.800Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3286f008f00ad81249bf516a","created_at":"2026-10-26T11:18:44.528Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.529Z","job_size_bytes":66,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3286f008f00ad81249bf516a: done: 0.019951 sec","job_status":"done","queue_duration_s":0.250783,"scheduling_latency_s":0.250801,"redis_calls":7,"redis_duration_s":0.0013469999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00106,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019951,"completed_at":"2026-10-26T11:18:44.800Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.004722] gitaly[896]: time="2026-10-26T11:18:44.475Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY9XP88E5CNQBQ5Z33BV1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.464" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.049919] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.801Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5d7112f8863548b3dac613e3","created_at":"2026-10-26T11:18:44.529Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.530Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5d7112f8863548b3dac613e3: start","job_status":"start","queue_duration_s":0.270433,"scheduling_latency_s":0.270447} gitlab # [ 242.050580] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.818Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5d7112f8863548b3dac613e3","created_at":"2026-10-26T11:18:44.529Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.530Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5d7112f8863548b3dac613e3: done: 0.017483 sec","job_status":"done","queue_duration_s":0.270433,"scheduling_latency_s":0.270447,"redis_calls":7,"redis_duration_s":0.001005,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017483,"completed_at":"2026-10-26T11:18:44.818Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.103881] gitaly[896]: time="2026-10-26T11:18:44.475Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY9XP88E5CNQBQ5Z33BV1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.464" grpc.time_ms=11.309 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.104669] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.819Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"385a7ad0cc3bff9ae7b7ff63","created_at":"2026-10-26T11:18:44.531Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.532Z","job_size_bytes":6,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-385a7ad0cc3bff9ae7b7ff63: start","job_status":"start","queue_duration_s":0.287371,"scheduling_latency_s":0.287386} gitlab # [ 242.105436] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.828Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"385a7ad0cc3bff9ae7b7ff63","created_at":"2026-10-26T11:18:44.531Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.532Z","job_size_bytes":6,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-385a7ad0cc3bff9ae7b7ff63: done: 0.008533 sec","job_status":"done","queue_duration_s":0.287371,"scheduling_latency_s":0.287386,"redis_calls":7,"redis_duration_s":0.000868,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008533,"completed_at":"2026-10-26T11:18:44.828Z","load_balancing_strategy":"primary","db_duration_s":0.000405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.152826] gitaly[896]: time="2026-10-26T11:18:44.491Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYY99ER77QK3C3Y0RGJ6JD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:44.490" grpc.time_ms=0.565 pid=896 span.kind=server system=grpc gitlab # [ 242.153636] gitaly[896]: time="2026-10-26T11:18:44.500Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY99ER77QK3C3Y0RGJ6JD diskcache=f1933592-4610-4472-b543-ef6db1c6799a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:14.320" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:44.420" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.154482] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.829Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"202fc160545d3b3471e13e97","created_at":"2026-10-26T11:18:44.532Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.534Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-202fc160545d3b3471e13e97: start","job_status":"start","queue_duration_s":0.294838,"scheduling_latency_s":0.29485} gitlab # [ 242.160848] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.845Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"202fc160545d3b3471e13e97","created_at":"2026-10-26T11:18:44.532Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.534Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-202fc160545d3b3471e13e97: done: 0.016094 sec","job_status":"done","queue_duration_s":0.294838,"scheduling_latency_s":0.29485,"redis_calls":7,"redis_duration_s":0.0010500000000000002,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016094,"completed_at":"2026-10-26T11:18:44.845Z","load_balancing_strategy":"primary","db_duration_s":0.004263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.221627] gitaly[896]: time="2026-10-26T11:18:44.500Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=60 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7072 command.oublock=0 command.real_time_ms=72 command.spawn_token_fork_ms=2 command.system_time_ms=41 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY99ER77QK3C3Y0RGJ6JD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:14.320" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:44.420" grpc.time_ms=79.512 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.222477] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.846Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e1e8b25b7df99e6b9ffc6045","created_at":"2026-10-26T11:18:44.582Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.584Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e1e8b25b7df99e6b9ffc6045: start","job_status":"start","queue_duration_s":0.261706,"scheduling_latency_s":0.261838} gitlab # [ 242.223046] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.864Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e1e8b25b7df99e6b9ffc6045","created_at":"2026-10-26T11:18:44.582Z","trace_propagation_headers":{"sentry-trace":"0ca1db02893f4c83b8850d09329e1bb0-89b6bcb1241640e6","baggage":"sentry-trace_id=0ca1db02893f4c83b8850d09329e1bb0,sentry-release=Unknown"},"correlation_id":"01M5VYY99ER77QK3C3Y0RGJ6JD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.584Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e1e8b25b7df99e6b9ffc6045: done: 0.017926 sec","job_status":"done","queue_duration_s":0.261706,"scheduling_latency_s":0.261838,"redis_calls":8,"redis_duration_s":0.001967,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001558,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000409,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017926,"completed_at":"2026-10-26T11:18:44.864Z","load_balancing_strategy":"primary","db_duration_s":0.002364,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.260030] gitaly[896]: time="2026-10-26T11:18:44.543Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYY99ER77QK3C3Y0RGJ6JD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T11:19:14.442" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:44.542" grpc.time_ms=0.745 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.271243] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.939Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a7aa1572350b7ce5e63c0503","created_at":"2026-10-26T11:18:44.934Z","trace_propagation_headers":{"sentry-trace":"049f466aac764aed826911280d7d6284-df4b1cfc2ecd4d4f","baggage":"sentry-trace_id=049f466aac764aed826911280d7d6284,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYYA9VYXBKXR90SZK4D369","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.937Z","job_size_bytes":65,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a7aa1572350b7ce5e63c0503: start","job_status":"start","queue_duration_s":0.001925,"scheduling_latency_s":0.001953} gitlab # [ 242.312884] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.964Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a7aa1572350b7ce5e63c0503","created_at":"2026-10-26T11:18:44.934Z","trace_propagation_headers":{"sentry-trace":"049f466aac764aed826911280d7d6284-df4b1cfc2ecd4d4f","baggage":"sentry-trace_id=049f466aac764aed826911280d7d6284,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYYA9VYXBKXR90SZK4D369","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.937Z","job_size_bytes":65,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a7aa1572350b7ce5e63c0503: done: 0.024729 sec","job_status":"done","queue_duration_s":0.001925,"scheduling_latency_s":0.001953,"redis_calls":7,"redis_duration_s":0.00115,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000352,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024729,"completed_at":"2026-10-26T11:18:44.964Z","load_balancing_strategy":"primary","db_duration_s":0.003792,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.351611] gitaly[896]: time="2026-10-26T11:18:44.554Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYA0J7T0YHGP32QH8C995 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.540" grpc.time_ms=13.241 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.352504] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:44.965Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ce8c5d708c6db0e9b444c7ac","created_at":"2026-10-26T11:18:44.938Z","trace_propagation_headers":{"sentry-trace":"049f466aac764aed826911280d7d6284-df4b1cfc2ecd4d4f","baggage":"sentry-trace_id=049f466aac764aed826911280d7d6284,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYYA9VYXBKXR90SZK4D369","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.941Z","job_size_bytes":65,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ce8c5d708c6db0e9b444c7ac: start","job_status":"start","queue_duration_s":0.023906,"scheduling_latency_s":0.023932} gitlab # [ 242.353126] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:45.005Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ce8c5d708c6db0e9b444c7ac","created_at":"2026-10-26T11:18:44.938Z","trace_propagation_headers":{"sentry-trace":"049f466aac764aed826911280d7d6284-df4b1cfc2ecd4d4f","baggage":"sentry-trace_id=049f466aac764aed826911280d7d6284,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYYA9VYXBKXR90SZK4D369","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.941Z","job_size_bytes":65,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ce8c5d708c6db0e9b444c7ac: done: 0.039621 sec","job_status":"done","queue_duration_s":0.023906,"scheduling_latency_s":0.023932,"redis_calls":10,"redis_duration_s":0.0029,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001656,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039621,"completed_at":"2026-10-26T11:18:45.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.393861] gitaly[896]: time="2026-10-26T11:18:44.574Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYY99ER77QK3C3Y0RGJ6JD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:14.472" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:44.573" grpc.time_ms=0.837 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.399969] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:45.007Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7c25453b8cb20d2765197d74","created_at":"2026-10-26T11:18:44.979Z","trace_propagation_headers":{"sentry-trace":"049f466aac764aed826911280d7d6284-df4b1cfc2ecd4d4f","baggage":"sentry-trace_id=049f466aac764aed826911280d7d6284,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYYA9VYXBKXR90SZK4D369","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.986Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7c25453b8cb20d2765197d74: start","job_status":"start","queue_duration_s":0.021125,"scheduling_latency_s":0.021141} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b' gitlab # [ 242.444309] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:45.093Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7c25453b8cb20d2765197d74","created_at":"2026-10-26T11:18:44.979Z","trace_propagation_headers":{"sentry-trace":"049f466aac764aed826911280d7d6284-df4b1cfc2ecd4d4f","baggage":"sentry-trace_id=049f466aac764aed826911280d7d6284,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYYA9VYXBKXR90SZK4D369","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:44.986Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7c25453b8cb20d2765197d74: done: 0.085925 sec","job_status":"done","queue_duration_s":0.021125,"scheduling_latency_s":0.021141,"gitaly_calls":2,"gitaly_duration_s":0.004272,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.005957,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000841,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000606,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000182,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000147,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000261,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001965,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055654,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.063457228,"duration_s":0.085925,"completed_at":"2026-10-26T11:18:45.093Z","load_balancing_strategy":"primary","db_duration_s":0.022378,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.490063] gitaly[896]: time="2026-10-26T11:18:44.594Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=13 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYA1A0MBPJ3S37GVAFYTQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.571" grpc.time_ms=22.881 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.490610] gitaly[896]: time="2026-10-26T11:18:44.615Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA2EBB52E2217F72GXYP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.606" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 242.491090] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:45.094Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2c3fd90f8038329ccd0f9a32","created_at":"2026-10-26T11:18:45.048Z","trace_propagation_headers":{"sentry-trace":"049f466aac764aed826911280d7d6284-9a60985315b14a67","baggage":"sentry-trace_id=049f466aac764aed826911280d7d6284,sentry-release=Unknown"},"correlation_id":"01M5VYYA9VYXBKXR90SZK4D369","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:45.050Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2c3fd90f8038329ccd0f9a32: start","job_status":"start","queue_duration_s":0.044137,"scheduling_latency_s":0.04415} gitlab # [ 242.527981] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:45.118Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2c3fd90f8038329ccd0f9a32","created_at":"2026-10-26T11:18:45.048Z","trace_propagation_headers":{"sentry-trace":"049f466aac764aed826911280d7d6284-9a60985315b14a67","baggage":"sentry-trace_id=049f466aac764aed826911280d7d6284,sentry-release=Unknown"},"correlation_id":"01M5VYYA9VYXBKXR90SZK4D369","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:45.050Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2c3fd90f8038329ccd0f9a32: done: 0.023928 sec","job_status":"done","queue_duration_s":0.044137,"scheduling_latency_s":0.04415,"redis_calls":7,"redis_duration_s":0.0019399999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001139,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023928,"completed_at":"2026-10-26T11:18:45.118Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.529214] gitaly[896]: time="2026-10-26T11:18:44.615Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA2EBB52E2217F72GXYP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.606" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.541048] gitaly[896]: time="2026-10-26T11:18:44.615Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA2EBB52E2217F72GXYP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.606" grpc.time_ms=9.01 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.553859] gitaly[896]: time="2026-10-26T11:18:44.652Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA3PSBRRMMBTG4JXAA8Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.638" pid=896 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 242.562807] gitaly[896]: time="2026-10-26T11:18:44.652Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA3PSBRRMMBTG4JXAA8Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.638" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.574988] gitaly[896]: time="2026-10-26T11:18:44.652Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA3PSBRRMMBTG4JXAA8Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.638" grpc.time_ms=14.033 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.588150] gitaly[896]: time="2026-10-26T11:18:44.707Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYA5H3PSZ5WFPSAXCE796 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.698" grpc.time_ms=9.177 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.631934] gitaly[896]: time="2026-10-26T11:18:44.758Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA76Y3C8CF1X63SMZ455 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.746" pid=896 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 242.632717] gitaly[896]: time="2026-10-26T11:18:44.758Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA76Y3C8CF1X63SMZ455 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.746" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.633454] gitaly[896]: time="2026-10-26T11:18:44.759Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA76Y3C8CF1X63SMZ455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T11:18:44.746" grpc.time_ms=12.929 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.634103] gitaly[896]: time="2026-10-26T11:18:44.830Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:14.729" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:44.829" grpc.time_ms=0.482 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.644765] gitaly[896]: time="2026-10-26T11:18:44.841Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-26T11:19:14.735" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:44.836" grpc.time_ms=5.583 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.688035] gitaly[896]: time="2026-10-26T11:18:44.850Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:18:54.105" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:44.845" grpc.time_ms=4.809 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.688759] gitaly[896]: time="2026-10-26T11:18:44.871Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T11:18:54.131" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:44.871" grpc.time_ms=0.208 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.689418] gitaly[896]: time="2026-10-26T11:18:44.879Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T11:18:54.134" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:44.874" grpc.time_ms=5.027 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.690025] gitaly[896]: time="2026-10-26T11:18:44.904Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:44.903" grpc.time_ms=0.284 pid=896 span.kind=server system=grpc gitlab # [ 242.698621] gitaly[896]: time="2026-10-26T11:18:44.922Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:44.921" grpc.time_ms=0.328 pid=896 span.kind=server system=grpc gitlab # [ 242.736862] gitaly[896]: time="2026-10-26T11:18:44.929Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 diskcache=cdfb7a91-3f30-4ffd-a3b4-ec02d1176cd6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T11:18:54.140" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:44.880" pid=896 ref=refs/keep-around/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b remote_ip="2001:db8:1::1" revision=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b span.kind=server system=grpc username=root gitlab # [ 242.737611] gitaly[896]: time="2026-10-26T11:18:44.929Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=39 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5225 command.oublock=8 command.real_time_ms=43 command.spawn_token_fork_ms=0 command.system_time_ms=27 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T11:18:54.140" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T11:18:44.880" grpc.time_ms=48.916 pid=896 ref=refs/keep-around/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b remote_ip="2001:db8:1::1" revision=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b span.kind=server system=grpc username=root gitlab # [ 242.738217] gitaly[896]: time="2026-10-26T11:18:44.932Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:14.831" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:44.932" grpc.time_ms=0.211 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.740615] gitaly[896]: time="2026-10-26T11:18:45.061Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T11:19:15.059" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:45.060" grpc.time_ms=0.622 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.751955] gitaly[896]: time="2026-10-26T11:18:45.086Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYA9VYXBKXR90SZK4D369 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:15.085" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:45.085" grpc.time_ms=0.429 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.821402] nixbot[2610]: {"ts": "2026-10-26T11:18:46.134Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:60794 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b HTTP/1.1\" 200"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', in 0.35 seconds) (finished: subtest: push delivers the webhook, in 47.09 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses gitlab # [ 242.864071] nix-daemon[2777]: accepted connection from pid 3611, user nixbot gitlab # [ 242.882979] gitaly[896]: time="2026-10-26T11:18:46.196Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYBMJ818AGQRA8MXD2A3H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:16.095" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:46.196" grpc.time_ms=0.47 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.900834] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 51 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses, in 0.07 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses gitlab # [ 243.999991] gitaly[896]: time="2026-10-26T11:18:47.313Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYCPP6QMGQVG6GAGS4J1D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:17.211" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:47.311" grpc.time_ms=0.938 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.024517] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 82 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses, in 0.13 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses gitlab # [ 245.153316] gitaly[896]: time="2026-10-26T11:18:48.466Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYDSXB19GCA6HR1A0117B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:18.464" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:48.465" grpc.time_ms=0.858 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.194399] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 125 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses, in 0.17 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses gitlab # [ 246.298157] gitaly[896]: time="2026-10-26T11:18:49.611Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYEYC8G3HDAB1YZTS5B4J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:19.609" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:49.610" grpc.time_ms=0.857 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.344751] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 108 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses, in 0.15 seconds) gitlab # [ 247.140917] nix-daemon[2777]: accepted connection from pid 3651, user nixbot gitlab # [ 247.152936] nix-daemon[2777]: accepted connection from pid 3611, user nixbot gitlab # [ 247.280183] gitaly[896]: time="2026-10-26T11:18:50.593Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:20.492" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:50.592" grpc.time_ms=0.861 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses gitlab # [ 247.333390] gitaly[896]: time="2026-10-26T11:18:50.646Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:19:00.286" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:50.636" grpc.time_ms=9.635 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.387396] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:50.699Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"fb9d13b47d0f0cee66c404af","created_at":"2026-10-26T11:18:50.692Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-0dbc57f3e05f43e0","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.697Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fb9d13b47d0f0cee66c404af: start","job_status":"start","queue_duration_s":0.001791,"scheduling_latency_s":0.001835} gitlab # [ 247.403449] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 207 gitlab # [ 247.457151] gitaly[896]: time="2026-10-26T11:18:50.770Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYG35PPS4XY21ANZ32AHM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:20.668" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:50.769" grpc.time_ms=0.567 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.469405] gitaly[896]: time="2026-10-26T11:18:50.783Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYG3KXM72JSXW65449A8M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:20.782" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:50.782" grpc.time_ms=0.418 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.487889] gitaly[896]: time="2026-10-26T11:18:50.799Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:50.799" grpc.time_ms=0.243 pid=896 span.kind=server system=grpc gitlab # [ 247.499353] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 73 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses, in 0.15 seconds) gitlab # [ 247.506570] gitaly[896]: time="2026-10-26T11:18:50.820Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:50.820" grpc.time_ms=0.207 pid=896 span.kind=server system=grpc gitlab # [ 247.517874] gitaly[896]: time="2026-10-26T11:18:50.831Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYG35PPS4XY21ANZ32AHM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:19:00.076" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:50.816" grpc.time_ms=14.709 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.531439] gitaly[896]: time="2026-10-26T11:18:50.845Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:50.844" grpc.time_ms=0.359 pid=896 span.kind=server system=grpc gitlab # [ 247.542530] gitaly[896]: time="2026-10-26T11:18:50.856Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:20.667" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:50.767" operations="[repack_refs]" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.552219] gitaly[896]: time="2026-10-26T11:18:50.857Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:20.667" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:50.767" pid=896 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-26 11:17:49.088630936 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 247.563453] gitaly[896]: time="2026-10-26T11:18:50.863Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH diskcache=cf55767d-4d21-42f5-88fb-4796079f30c6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:20.667" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:50.767" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.563755] gitaly[896]: time="2026-10-26T11:18:50.864Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=84 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7652 command.oublock=0 command.real_time_ms=89 command.spawn_token_fork_ms=0 command.system_time_ms=56 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:20.667" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:50.767" grpc.time_ms=96.087 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.564824] gitaly[896]: time="2026-10-26T11:18:50.871Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:20.667" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:50.767" pid=896 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 247.565484] gitaly[896]: time="2026-10-26T11:18:50.871Z" level=info msg="optimized repository" clean_stale_data_time=13.542783ms clean_work_trees_time="80.457µs" commit_graph_time="3.352µs" correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=896 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.191µs" storage_name=default system=housekeeping total_time=13.728281ms gitlab # [ 247.565965] gitaly[896]: time="2026-10-26T11:18:50.871Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:20.667" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:50.767" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.569853] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 158 gitlab # [ 247.600116] gitaly[896]: time="2026-10-26T11:18:50.913Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T11:19:20.812" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:50.913" grpc.time_ms=0.75 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.618267] gitaly[896]: time="2026-10-26T11:18:50.932Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYG8GAWX9BF1JQJA81QKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:20.831" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:50.931" grpc.time_ms=0.608 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.621076] gitaly[896]: time="2026-10-26T11:18:50.934Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:20.834" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:50.934" grpc.time_ms=0.553 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.627652] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:50.941Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e9ef118da1fb4df326b90892","created_at":"2026-10-26T11:18:50.940Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"fb9d13b47d0f0cee66c404af","job_size_bytes":3,"pid":2486,"job_status":"deduplicated","message":"PipelineProcessWorker JID-e9ef118da1fb4df326b90892: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 247.628641] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:50.942Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"fb9d13b47d0f0cee66c404af","created_at":"2026-10-26T11:18:50.692Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-0dbc57f3e05f43e0","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.697Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2486,"job_status":"rescheduled","message":"PipelineProcessWorker JID-fb9d13b47d0f0cee66c404af: rescheduled"} gitlab # [ 247.668891] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:50.947Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"fb9d13b47d0f0cee66c404af","created_at":"2026-10-26T11:18:50.692Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-0dbc57f3e05f43e0","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.697Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fb9d13b47d0f0cee66c404af: done: 0.248073 sec","job_status":"done","queue_duration_s":0.001791,"scheduling_latency_s":0.001835,"gitaly_calls":3,"gitaly_duration_s":0.104119,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015375999999999999,"redis_read_bytes":239,"redis_write_bytes":21782,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000898,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001001,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003423,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14467,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.005653,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000138,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001032,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002333,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098601,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.211069284,"duration_s":0.248073,"completed_at":"2026-10-26T11:18:50.947Z","load_balancing_strategy":"primary","db_duration_s":0.028454,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.709352] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:50.948Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"85a4ccb067deaae1d4f7d521","created_at":"2026-10-26T11:18:50.760Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.762Z","job_size_bytes":23,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-85a4ccb067deaae1d4f7d521: start","job_status":"start","queue_duration_s":0.185675,"scheduling_latency_s":0.185691} gitlab # [ 247.710068] gitaly[896]: time="2026-10-26T11:18:50.964Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYG8GAWX9BF1JQJA81QKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T11:19:00.212" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:50.952" grpc.time_ms=11.901 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.710687] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/26:11:18:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 100 gitlab # [ 247.711368] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:50.973Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"85a4ccb067deaae1d4f7d521","created_at":"2026-10-26T11:18:50.760Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.762Z","job_size_bytes":23,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-85a4ccb067deaae1d4f7d521: done: 0.025369 sec","job_status":"done","queue_duration_s":0.185675,"scheduling_latency_s":0.185691,"redis_calls":7,"redis_duration_s":0.0013310000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000613,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025369,"completed_at":"2026-10-26T11:18:50.973Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004799,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.765324] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:50.974Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"809bd1085c1b346f8b5a0182","created_at":"2026-10-26T11:18:50.868Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.871Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-809bd1085c1b346f8b5a0182: start","job_status":"start","queue_duration_s":0.103773,"scheduling_latency_s":0.103788} gitlab # [ 247.765983] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:50.995Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"809bd1085c1b346f8b5a0182","created_at":"2026-10-26T11:18:50.868Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.871Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-809bd1085c1b346f8b5a0182: done: 0.020476 sec","job_status":"done","queue_duration_s":0.103773,"scheduling_latency_s":0.103788,"redis_calls":7,"redis_duration_s":0.000911,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020476,"completed_at":"2026-10-26T11:18:50.995Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.831813] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:50.996Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"953b55e4361eb90dc1bbcad6","created_at":"2026-10-26T11:18:50.880Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.885Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-953b55e4361eb90dc1bbcad6: start","job_status":"start","queue_duration_s":0.110968,"scheduling_latency_s":0.110982} gitlab # [ 247.832650] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.016Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"953b55e4361eb90dc1bbcad6","created_at":"2026-10-26T11:18:50.880Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.885Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-953b55e4361eb90dc1bbcad6: done: 0.02024 sec","job_status":"done","queue_duration_s":0.110968,"scheduling_latency_s":0.110982,"redis_calls":7,"redis_duration_s":0.000949,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02024,"completed_at":"2026-10-26T11:18:51.016Z","load_balancing_strategy":"primary","db_duration_s":0.004772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.882968] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.017Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"6701a9465f738b5ce97e7b79","created_at":"2026-10-26T11:18:50.892Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.893Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6701a9465f738b5ce97e7b79: start","job_status":"start","queue_duration_s":0.123452,"scheduling_latency_s":0.123466} gitlab # [ 247.883718] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.044Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"6701a9465f738b5ce97e7b79","created_at":"2026-10-26T11:18:50.892Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.893Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6701a9465f738b5ce97e7b79: done: 0.027553 sec","job_status":"done","queue_duration_s":0.123452,"scheduling_latency_s":0.123466,"redis_calls":10,"redis_duration_s":0.002745,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001857,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027553,"completed_at":"2026-10-26T11:18:51.044Z","load_balancing_strategy":"primary","db_duration_s":0.007886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.927814] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.045Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0f37c4cbaad7afc8689aeeba","created_at":"2026-10-26T11:18:50.894Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.895Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0f37c4cbaad7afc8689aeeba: start","job_status":"start","queue_duration_s":0.150488,"scheduling_latency_s":0.150503} gitlab # [ 247.928745] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.061Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0f37c4cbaad7afc8689aeeba","created_at":"2026-10-26T11:18:50.894Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.895Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0f37c4cbaad7afc8689aeeba: done: 0.015299 sec","job_status":"done","queue_duration_s":0.150488,"scheduling_latency_s":0.150503,"redis_calls":7,"redis_duration_s":0.001109,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015299,"completed_at":"2026-10-26T11:18:51.061Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.977197] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.061Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a63e40517cdc77d7c10aadaf","created_at":"2026-10-26T11:18:50.895Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.897Z","job_size_bytes":19,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a63e40517cdc77d7c10aadaf: start","job_status":"start","queue_duration_s":0.164372,"scheduling_latency_s":0.164385} gitlab # [ 247.977896] gitaly[896]: time="2026-10-26T11:18:51.215Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:51.214" grpc.time_ms=0.478 pid=896 span.kind=server system=grpc gitlab # [ 247.980916] gitaly[896]: time="2026-10-26T11:18:51.232Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:51.232" grpc.time_ms=0.195 pid=896 span.kind=server system=grpc gitlab # [ 248.025347] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.076Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a63e40517cdc77d7c10aadaf","created_at":"2026-10-26T11:18:50.895Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.897Z","job_size_bytes":19,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a63e40517cdc77d7c10aadaf: done: 0.014244 sec","job_status":"done","queue_duration_s":0.164372,"scheduling_latency_s":0.164385,"redis_calls":8,"redis_duration_s":0.001008,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014244,"completed_at":"2026-10-26T11:18:51.076Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002087,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.026835] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.076Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8eeba4244299ea936639e64d","created_at":"2026-10-26T11:18:50.898Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.899Z","job_size_bytes":66,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8eeba4244299ea936639e64d: start","job_status":"start","queue_duration_s":0.177772,"scheduling_latency_s":0.177786} gitlab # [ 248.079764] gitaly[896]: time="2026-10-26T11:18:51.250Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T11:18:51.250" grpc.time_ms=0.286 pid=896 span.kind=server system=grpc gitlab # [ 248.080552] gitaly[896]: time="2026-10-26T11:18:51.259Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH diskcache=7192cb6f-977c-43dd-b407-12f101d37009 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:21.095" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:51.195" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.081147] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.097Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8eeba4244299ea936639e64d","created_at":"2026-10-26T11:18:50.898Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.899Z","job_size_bytes":66,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8eeba4244299ea936639e64d: done: 0.020849 sec","job_status":"done","queue_duration_s":0.177772,"scheduling_latency_s":0.177786,"redis_calls":7,"redis_duration_s":0.006213,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003445,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002768,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020849,"completed_at":"2026-10-26T11:18:51.097Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003761,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.098494] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.098Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"33d7bae2fa3d4871459f7917","created_at":"2026-10-26T11:18:50.899Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.900Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-33d7bae2fa3d4871459f7917: start","job_status":"start","queue_duration_s":0.198075,"scheduling_latency_s":0.198088} gitlab # [ 248.150757] gitaly[896]: time="2026-10-26T11:18:51.259Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=62 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7168 command.oublock=0 command.real_time_ms=56 command.spawn_token_fork_ms=0 command.system_time_ms=40 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T11:19:21.095" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T11:18:51.195" grpc.time_ms=64.01 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.151458] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.119Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"33d7bae2fa3d4871459f7917","created_at":"2026-10-26T11:18:50.899Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.900Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-33d7bae2fa3d4871459f7917: done: 0.020568 sec","job_status":"done","queue_duration_s":0.198075,"scheduling_latency_s":0.198088,"redis_calls":7,"redis_duration_s":0.0009010000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020568,"completed_at":"2026-10-26T11:18:51.119Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.194510] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.120Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"de18739f2b7f6ec9eec8a4ba","created_at":"2026-10-26T11:18:50.902Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.903Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-de18739f2b7f6ec9eec8a4ba: start","job_status":"start","queue_duration_s":0.216391,"scheduling_latency_s":0.216405} gitlab # [ 248.195307] gitaly[896]: time="2026-10-26T11:18:51.291Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T11:19:21.190" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:51.291" grpc.time_ms=0.486 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.196066] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.134Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"de18739f2b7f6ec9eec8a4ba","created_at":"2026-10-26T11:18:50.902Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.903Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-de18739f2b7f6ec9eec8a4ba: done: 0.014684 sec","job_status":"done","queue_duration_s":0.216391,"scheduling_latency_s":0.216405,"redis_calls":7,"redis_duration_s":0.0008730000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000634,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014684,"completed_at":"2026-10-26T11:18:51.134Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.251338] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.135Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0df6d079cba94d06d5696736","created_at":"2026-10-26T11:18:50.904Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.905Z","job_size_bytes":6,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0df6d079cba94d06d5696736: start","job_status":"start","queue_duration_s":0.230413,"scheduling_latency_s":0.230425} gitlab # [ 248.252056] gitaly[896]: time="2026-10-26T11:18:51.311Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5VYYFWCMVVTE7SCFVY7JMPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T11:19:21.210" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T11:18:51.311" grpc.time_ms=0.434 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.252693] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.143Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0df6d079cba94d06d5696736","created_at":"2026-10-26T11:18:50.904Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.905Z","job_size_bytes":6,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0df6d079cba94d06d5696736: done: 0.007969 sec","job_status":"done","queue_duration_s":0.230413,"scheduling_latency_s":0.230425,"redis_calls":7,"redis_duration_s":0.00081,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000223,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007969,"completed_at":"2026-10-26T11:18:51.143Z","load_balancing_strategy":"primary","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.294664] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.144Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"d5aa49e1e6962358b98050d4","created_at":"2026-10-26T11:18:50.905Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.906Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d5aa49e1e6962358b98050d4: start","job_status":"start","queue_duration_s":0.238065,"scheduling_latency_s":0.238077} gitlab # [ 248.300126] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.157Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"d5aa49e1e6962358b98050d4","created_at":"2026-10-26T11:18:50.905Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.906Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d5aa49e1e6962358b98050d4: done: 0.012719 sec","job_status":"done","queue_duration_s":0.238065,"scheduling_latency_s":0.238077,"redis_calls":7,"redis_duration_s":0.000941,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012719,"completed_at":"2026-10-26T11:18:51.157Z","load_balancing_strategy":"primary","db_duration_s":0.001756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.337265] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.158Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"b39f2610b15734cb499a5e81","created_at":"2026-10-26T11:18:50.942Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.944Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b39f2610b15734cb499a5e81: start","job_status":"start","queue_duration_s":0.213669,"scheduling_latency_s":0.213682} gitlab # [ 248.375294] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.319Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"b39f2610b15734cb499a5e81","created_at":"2026-10-26T11:18:50.942Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.944Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2486,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b39f2610b15734cb499a5e81: rescheduled"} gitlab # [ 248.375496] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.323Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"b39f2610b15734cb499a5e81","created_at":"2026-10-26T11:18:50.942Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-7d232b78b5db4835","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:50.944Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b39f2610b15734cb499a5e81: done: 0.16566 sec","job_status":"done","queue_duration_s":0.213669,"scheduling_latency_s":0.213682,"gitaly_calls":3,"gitaly_duration_s":0.071744,"redis_calls":68,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.00778,"redis_read_bytes":149,"redis_write_bytes":18168,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000308,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000956,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":22,"redis_queues_duration_s":0.0018,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12310,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.00264,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000149,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000512,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072465,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.143861022,"duration_s":0.16566,"completed_at":"2026-10-26T11:18:51.323Z","load_balancing_strategy":"primary","db_duration_s":0.018299,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.431203] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.324Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fe4a7bdce4c4a5be114483fc","created_at":"2026-10-26T11:18:51.190Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-c86e2541094747d6","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:51.192Z","job_size_bytes":23,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fe4a7bdce4c4a5be114483fc: start","job_status":"start","queue_duration_s":0.132405,"scheduling_latency_s":0.132421} gitlab # [ 248.431871] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.349Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fe4a7bdce4c4a5be114483fc","created_at":"2026-10-26T11:18:51.190Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-c86e2541094747d6","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:51.192Z","job_size_bytes":23,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fe4a7bdce4c4a5be114483fc: done: 0.024576 sec","job_status":"done","queue_duration_s":0.132405,"scheduling_latency_s":0.132421,"redis_calls":7,"redis_duration_s":0.000966,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024576,"completed_at":"2026-10-26T11:18:51.349Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00485,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses gitlab # [ 248.492775] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.350Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"91c30f57d88d2609e27fea11","created_at":"2026-10-26T11:18:51.263Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-c86e2541094747d6","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:51.265Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-91c30f57d88d2609e27fea11: start","job_status":"start","queue_duration_s":0.084509,"scheduling_latency_s":0.084523} gitlab # [ 248.493646] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.365Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"91c30f57d88d2609e27fea11","created_at":"2026-10-26T11:18:51.263Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-c86e2541094747d6","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:51.265Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-91c30f57d88d2609e27fea11: done: 0.015202 sec","job_status":"done","queue_duration_s":0.084509,"scheduling_latency_s":0.084523,"redis_calls":7,"redis_duration_s":0.000912,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015202,"completed_at":"2026-10-26T11:18:51.365Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.532125] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.366Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0269d4eb47467b28edd29b93","created_at":"2026-10-26T11:18:51.269Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-c86e2541094747d6","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:51.271Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0269d4eb47467b28edd29b93: start","job_status":"start","queue_duration_s":0.095375,"scheduling_latency_s":0.095404} gitlab # [ 248.532728] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.385Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0269d4eb47467b28edd29b93","created_at":"2026-10-26T11:18:51.269Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-c86e2541094747d6","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:51.271Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0269d4eb47467b28edd29b93: done: 0.019161 sec","job_status":"done","queue_duration_s":0.095375,"scheduling_latency_s":0.095404,"redis_calls":7,"redis_duration_s":0.000923,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019161,"completed_at":"2026-10-26T11:18:51.385Z","load_balancing_strategy":"primary","db_duration_s":0.002576,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.564367] nixbot[2610]: {"ts": "2026-10-26T11:18:51.826Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 2, "sha": "7fd835d0d8fb588dcac6b74e98bb43aac4b6397b", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7fd835d0d8fb588dcac6b74e98bb43aac4b6397b/statuses, in 0.11 seconds) (finished: subtest: eval and build post commit statuses, in 5.78 seconds) (finished: run the VM test script, in 295.56 seconds) gitlab # [ 248.566662] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.386Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e202035dd1871ba3f51fbd2f","created_at":"2026-10-26T11:18:51.276Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-c86e2541094747d6","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:51.277Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e202035dd1871ba3f51fbd2f: start","job_status":"start","queue_duration_s":0.109571,"scheduling_latency_s":0.109584} test script finished in 295.58s cleanup kill QemuMachine (pid 46) gitlab # [ 248.616656] sidekiq-cluster[2486]: {"severity":"INFO","time":"2026-10-26T11:18:51.404Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e202035dd1871ba3f51fbd2f","created_at":"2026-10-26T11:18:51.276Z","trace_propagation_headers":{"sentry-trace":"1206bcbff83a45b2b79128c6812ceddf-c86e2541094747d6","baggage":"sentry-trace_id=1206bcbff83a45b2b79128c6812ceddf,sentry-release=Unknown"},"correlation_id":"01M5VYYFWCMVVTE7SCFVY7JMPH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-26T11:18:51.277Z","job_size_bytes":3,"pid":2486,"sidekiq_tid":"m7z2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e202035dd1871ba3f51fbd2f: done: 0.017759 sec","job_status":"done","queue_duration_s":0.109571,"scheduling_latency_s":0.109584,"redis_calls":10,"redis_duration_s":0.001286,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000409,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_prqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) gitlab # i (finished: cleanup, in 1.18 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-26T11:17:58.638Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-26T11:18:44.786625Z', 'started_at': '2026-10-26T11:18:45.010373Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}] [{'id': 5, 'sha': '7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T11:18:44.973Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T11:18:44.973Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T11:18:44.973Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T11:18:44.973Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-10-26T11:18:44.973Z', 'started_at': None, 'finished_at': '2026-10-26T11:18:50.680Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-10-26T11:18:44.973Z', 'started_at': None, 'finished_at': '2026-10-26T11:18:50.680Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '7fd835d0d8fb588dcac6b74e98bb43aac4b6397b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-26T11:18:50.860Z', 'started_at': None, 'finished_at': '2026-10-26T11:18:50.977Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]