tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.T0UWAX2bMh', fmt=raw size=1073741824 (finished: start all VMs, in 49.11 seconds) gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab: waiting for unit setup-gitlab.service gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for the VM to finish booting gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: 86558f25-be50-4841-956c-2ae55af051a1 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5fzqssb8bl6z091k7ahcaxag1sfxy70b-nixos-system-gitlab-test/init regInfo=/nix/store/0rzdkjckanyndf5580vm559crrpqcls7-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 540288361 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000876] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002731] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002742] Using GB pages for direct mapping gitlab # [ 0.002916] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002922] ACPI: Early table checksum verification disabled gitlab # [ 0.002925] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002929] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002933] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002940] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002942] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002943] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002945] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002946] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002948] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002949] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002949] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002950] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002950] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002951] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003172] No NUMA configuration found gitlab # [ 0.003173] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003176] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff] gitlab # [ 0.005530] Zone ranges: gitlab # [ 0.005531] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005533] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005534] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005535] Device empty gitlab # [ 0.005535] Movable zone start for each node gitlab # [ 0.005536] Early memory node ranges gitlab # [ 0.005536] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005538] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005538] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005539] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005559] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.005832] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.116192] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.116631] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.116647] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.116682] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.116685] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.116687] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.116688] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.116689] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.116690] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.116692] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.116693] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.116698] TSC deadline timer available gitlab # [ 0.116703] CPU topo: Max. logical packages: 1 gitlab # [ 0.116704] CPU topo: Max. logical dies: 1 gitlab # [ 0.116704] CPU topo: Max. dies per package: 1 gitlab # [ 0.116708] CPU topo: Max. threads per core: 1 gitlab # [ 0.116708] CPU topo: Num. cores per package: 4 gitlab # [ 0.116709] CPU topo: Num. threads per package: 4 gitlab # [ 0.116709] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.116733] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.116750] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.116753] kvm-guest: setup PV sched yield gitlab # [ 0.116768] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.116770] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.116771] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.116772] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.116774] Booting paravirtualized kernel on KVM gitlab # [ 0.116778] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.121220] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.123788] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.123840] kvm-guest: PV spinlocks enabled gitlab # [ 0.123842] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.123845] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5fzqssb8bl6z091k7ahcaxag1sfxy70b-nixos-system-gitlab-test/init regInfo=/nix/store/0rzdkjckanyndf5580vm559crrpqcls7-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.123939] Unknown kernel command line parameters "regInfo=/nix/store/0rzdkjckanyndf5580vm559crrpqcls7-closure-info/registration", will be passed to user space. gitlab # [ 0.123953] random: crng init done gitlab # [ 0.123953] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.132953] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.137280] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.137365] software IO TLB: area num 4. gitlab # [ 0.212546] Fallback order for Node 0: 0 gitlab # [ 0.212554] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.212556] Policy zone: Normal gitlab # [ 0.215431] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.225244] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.239048] allocated 12582912 bytes of page_ext gitlab # [ 0.249026] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.249027] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.249903] Dynamic Preempt: lazy gitlab # [ 0.250428] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.250429] rcu: RCU event tracing is enabled. gitlab # [ 0.250430] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.250431] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.250431] Rude variant of Tasks RCU enabled. gitlab # [ 0.250432] Tracing variant of Tasks RCU enabled. gitlab # [ 0.250432] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.250433] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.250459] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.250461] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.250462] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.254843] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.255169] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.255177] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.255290] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.258895] Console: colour VGA+ 80x25 gitlab # [ 0.258898] printk: legacy console [tty0] enabled gitlab # [ 0.289788] printk: legacy console [ttyS0] enabled gitlab # [ 0.397417] ACPI: Core revision 20250807 gitlab # [ 0.398344] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.399944] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.401020] x2apic enabled gitlab # [ 0.401773] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.402704] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.404010] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.405525] kvm-guest: setup PV IPIs gitlab # [ 0.407135] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.408197] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns gitlab # [ 0.410080] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) gitlab # [ 0.411165] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.412203] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.414078] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.415082] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.417078] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.418078] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.419077] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.420078] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.421078] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.422085] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.423079] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.425079] active return thunk: srso_alias_return_thunk gitlab # [ 0.426100] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.427078] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.428078] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.429914] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.431078] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.432078] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.433078] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.434078] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.435967] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.437078] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.438078] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.439078] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.440078] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.470089] Freeing SMP alternatives memory: 44K gitlab # [ 0.470932] pid_max: default: 32768 minimum: 301 gitlab # [ 0.471780] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.472184] landlock: Up and running. gitlab # [ 0.473566] Yama: becoming mindful. gitlab # [ 0.474292] LSM support for eBPF active gitlab # [ 0.475317] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.476228] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.479598] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.480657] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.481083] ... version: 2 gitlab # [ 0.481832] ... bit width: 48 gitlab # [ 0.482081] ... generic counters: 6 gitlab # [ 0.482855] ... generic bitmap: 000000000000003f gitlab # [ 0.483129] ... fixed-purpose counters: 0 gitlab # [ 0.483917] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.484808] ... value mask: 0000ffffffffffff gitlab # [ 0.485080] ... max period: 00007fffffffffff gitlab # [ 0.486062] ... global_ctrl mask: 000000000000003f gitlab # [ 0.486948] signal: max sigframe size: 3376 gitlab # [ 0.487689] rcu: Hierarchical SRCU implementation. gitlab # [ 0.488083] rcu: Max phase no-delay instances is 400. gitlab # [ 0.489174] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.494587] smp: Bringing up secondary CPUs ... gitlab # [ 0.495506] smpboot: x86: Booting SMP configuration: gitlab # [ 0.496090] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.500163] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.501613] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) gitlab # [ 0.503337] Memory: 6011544K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260116K reserved, 0K cma-reserved) gitlab # [ 0.505244] devtmpfs: initialized gitlab # [ 0.506123] x86/mm: Memory block size: 128MB gitlab # [ 0.509247] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.510164] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.511190] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.512426] PM: RTC time: 14:46:14, date: 2026-10-06 gitlab # [ 0.516037] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.518284] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.519146] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.521597] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.522092] audit: initializing netlink subsys (disabled) gitlab # [ 0.523143] audit: type=2000 audit(1791297974.318:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.523355] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.525083] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.526080] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.527080] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.528080] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.529095] cpuidle: using governor menu gitlab # [ 0.531350] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.532369] PCI: Using configuration type 1 for base access gitlab # [ 0.533082] PCI: Using configuration type 1 for extended access gitlab # [ 0.534265] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.537580] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.539018] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.539969] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.540996] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.546378] ACPI: Added _OSI(Module Device) gitlab # [ 0.548094] ACPI: Added _OSI(Processor Device) gitlab # [ 0.550090] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.558038] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.564598] ACPI: Interpreter enabled gitlab # [ 0.566157] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.568091] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.570183] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.574091] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.577563] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.590341] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.593101] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.596007] acpiphp: Slot [3] registered gitlab # [ 0.598147] acpiphp: Slot [4] registered gitlab # [ 0.599137] acpiphp: Slot [5] registered gitlab # [ 0.601169] acpiphp: Slot [6] registered gitlab # [ 0.602138] acpiphp: Slot [7] registered gitlab # [ 0.603133] acpiphp: Slot [8] registered gitlab # [ 0.605157] acpiphp: Slot [9] registered gitlab # [ 0.606134] acpiphp: Slot [10] registered gitlab # [ 0.608138] acpiphp: Slot [11] registered gitlab # [ 0.609138] acpiphp: Slot [12] registered gitlab # [ 0.610125] acpiphp: Slot [13] registered gitlab # [ 0.610839] acpiphp: Slot [14] registered gitlab # [ 0.612101] acpiphp: Slot [15] registered gitlab # [ 0.612854] acpiphp: Slot [16] registered gitlab # [ 0.613112] acpiphp: Slot [17] registered gitlab # [ 0.613834] acpiphp: Slot [18] registered gitlab # [ 0.614112] acpiphp: Slot [19] registered gitlab # [ 0.614898] acpiphp: Slot [20] registered gitlab # [ 0.615721] acpiphp: Slot [21] registered gitlab # [ 0.617103] acpiphp: Slot [22] registered gitlab # [ 0.617844] acpiphp: Slot [23] registered gitlab # [ 0.618112] acpiphp: Slot [24] registered gitlab # [ 0.618908] acpiphp: Slot [25] registered gitlab # [ 0.619937] acpiphp: Slot [26] registered gitlab # [ 0.620700] acpiphp: Slot [27] registered gitlab # [ 0.622154] acpiphp: Slot [28] registered gitlab # [ 0.622914] acpiphp: Slot [29] registered gitlab # [ 0.623606] acpiphp: Slot [30] registered gitlab # [ 0.624110] acpiphp: Slot [31] registered gitlab # [ 0.624892] PCI host bridge to bus 0000:00 gitlab # [ 0.625697] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.627096] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.628081] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.629232] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.631095] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.633209] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.636161] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.641701] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.646280] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.653176] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.656155] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.658086] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.661087] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.664086] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.666591] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.673157] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.677205] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.680645] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.683097] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.685516] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.714247] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.716126] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.719158] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.723238] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.728410] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.738126] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.740105] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.743143] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.772106] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.777407] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.784124] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.785090] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.786105] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.788861] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.794119] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.795058] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.795909] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.798333] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.803121] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.804821] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.806140] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.809441] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.814134] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.816090] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.817103] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.819440] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.823114] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.824049] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.826105] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.828392] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.832118] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.833089] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.834103] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.835087] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.838413] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.841094] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.842110] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.844346] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.850134] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.851112] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.852103] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.854753] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.860126] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.861087] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.862111] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.866994] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.868109] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.869224] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.870224] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.872163] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.875120] iommu: Default domain type: Translated gitlab # [ 0.875980] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.877474] ACPI: bus type USB registered gitlab # [ 0.878158] usbcore: registered new interface driver usbfs gitlab # [ 0.879105] usbcore: registered new interface driver hub gitlab # [ 0.880104] usbcore: registered new device driver usb gitlab # [ 0.882710] NetLabel: Initializing gitlab # [ 0.883082] NetLabel: domain hash size = 128 gitlab # [ 0.883871] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.884995] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.885838] PCI: Using ACPI for IRQ routing gitlab # [ 0.887379] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.888077] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.888077] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.891085] vgaarb: loaded gitlab # [ 0.891896] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.892761] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.898192] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.900038] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.900825] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.902551] pnp: PnP ACPI init gitlab # [ 0.903746] pnp: PnP ACPI: found 6 devices gitlab # [ 0.915920] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.919696] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.922439] NET: Registered PF_INET protocol family gitlab # [ 0.927616] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.953554] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.955124] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.956596] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.960524] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.961981] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.963212] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.964609] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.965797] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.967336] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.968412] NET: Registered PF_XDP protocol family gitlab # [ 0.969293] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 0.970358] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 0.971433] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 0.972616] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.973797] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.975245] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 0.976270] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 0.978816] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 0.981534] PCI: CLS 0 bytes, default 64 gitlab # [ 0.982367] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 0.983075] Trying to unpack rootfs image as initramfs... gitlab # [ 0.983488] software IO TLB: mapped [mem 0x00000000b4400000-0x00000000b8400000] (64MB) gitlab # [ 0.986373] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns gitlab # [ 1.007365] Initialise system trusted keyrings gitlab # [ 1.008700] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 1.020428] Key type asymmetric registered gitlab # [ 1.021181] Asymmetric key parser 'x509' registered gitlab # [ 1.022189] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 1.024145] io scheduler mq-deadline registered gitlab # [ 1.026399] io scheduler kyber registered gitlab # [ 1.032974] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 1.036300] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 1.041816] Linux agpgart interface v0.103 gitlab # [ 1.043800] ACPI: bus type drm_connector registered gitlab # [ 1.048676] usbcore: registered new interface driver usbserial_generic gitlab # [ 1.051403] usbserial: USB Serial support registered for generic gitlab # [ 1.053885] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 1.053885] Please enable it if your BIOS has the CPPC option. gitlab # [ 1.059448] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 1.063011] drop_monitor: Initializing network drop monitor service gitlab # [ 1.066039] NET: Registered PF_INET6 protocol family gitlab # [ 1.069742] Segment Routing with IPv6 gitlab # [ 1.071571] In-situ OAM (IOAM) with IPv6 gitlab # [ 1.075543] IPI shorthand broadcast: enabled gitlab # [ 1.084525] sched_clock: Marking stable (937034556, 146900445)->(1110302438, -26367437) gitlab # [ 1.086893] registered taskstats version 1 gitlab # [ 1.088032] Loading compiled-in X.509 certificates gitlab # [ 1.098316] Demotion targets for Node 0: null gitlab # [ 1.099516] Key type .fscrypt registered gitlab # [ 1.100244] Key type fscrypt-provisioning registered gitlab # [ 1.101340] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.102347] ima: Allocated hash algorithm: sha1 gitlab # [ 1.103218] ima: No architecture policies found gitlab # [ 1.104476] PM: Magic number: 14:196:788 gitlab # [ 1.106220] RAS: Correctable Errors collector initialized. gitlab # [ 1.110801] clk: Disabling unused clocks gitlab # [ 1.111533] PM: genpd: Disabling unused power domains gitlab # [ 1.296356] Freeing initrd memory: 29392K gitlab # [ 1.303778] Freeing unused decrypted memory: 2028K gitlab # [ 1.310213] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.312962] Write protecting the kernel read-only data: 32768k gitlab # [ 1.317861] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.321848] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.390071] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.391270] Run /init as init process gitlab # [ 1.405615] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.429646] fuse: init (API version 7.45) gitlab # [ 1.438682] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.447383] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.450974] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.494676] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.830730] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.860500] systemd[1]: Detected virtualization kvm. gitlab # [ 1.861410] systemd[1]: Detected architecture x86-64. gitlab # [ 1.862287] systemd[1]: Running in initrd. gitlab # [ 1.863422] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.864626] systemd[1]: Hostname set to . gitlab # [ 1.966301] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 2.008732] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 2.017590] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 2.018779] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 2.020313] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 2.021503] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 2.022662] systemd[1]: Reached target Path Units. gitlab # [ 2.023548] systemd[1]: Reached target Slice Units. gitlab # [ 2.024471] systemd[1]: Reached target Swaps. gitlab # [ 2.025290] systemd[1]: Reached target Timer Units. gitlab # [ 2.026320] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 2.027561] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 2.028745] systemd[1]: Listening on Journal Sockets. gitlab # [ 2.029802] systemd[1]: Listening on udev Control Socket. gitlab # [ 2.030887] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 2.031873] systemd[1]: Reached target Socket Units. gitlab # [ 2.033981] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 2.036134] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 2.038266] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 2.042987] systemd[1]: Starting Journal Service... gitlab # [ 2.045318] systemd[1]: Starting Load Kernel Modules... gitlab # [ 2.046342] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 2.055992] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.061991] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.068483] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.072219] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.073499] systemd-journald[92]: Collecting audit messages is disabled. gitlab # [ 2.080177] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.081775] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.100508] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 2.104214] netfs: FS-Cache loaded gitlab # [ 2.105128] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 2.108038] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.113030] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 2.116652] 9pnet: Installing 9P2000 support gitlab # [ 2.120729] systemd[1]: Finished Load Kernel Modules. gitlab # [ 2.123064] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 2.126420] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.980993] systemd-modules-load[94]: Using 4 probe threads gitlab # [ 2.128849] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.982508] systemd-modules-load[94]: Inserted module 'virtio_balloon' gitlab # [ 2.130193] systemd[1]: Started Journal Service. gitlab # [ 1.984298] systemd-modules-load[94]: Inserted module 'dm_mod' gitlab # [ 1.985762] systemd-modules-load[94]: Inserted module 'virtio_gpu' gitlab # [ 1.986978] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.992164] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.993545] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.994554] systemd[1]: Reached target Local File Systems. gitlab # [ 1.996292] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.998530] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 2.011861] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.020064] systemd-udevd[113]: Using default interface naming scheme 'v261'. gitlab # [ 2.031699] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.059527] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.060408] systemd[1]: Reached target System Initialization. gitlab # [ 2.061230] systemd[1]: Reached target Basic System. gitlab # [ 2.279926] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.283131] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.285097] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.287000] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.288391] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.294422] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.295453] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.296970] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.298312] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.299460] usb usb1: Product: UHCI Host Controller gitlab # [ 2.300232] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.301061] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.304798] virtio_blk virtio5: [vdb] 11953048 512-byte logical blocks (6.12 GB/5.70 GiB) gitlab # [ 2.311446] SCSI subsystem initialized gitlab # [ 2.321130] hub 1-0:1.0: USB hub found gitlab # [ 2.322038] hub 1-0:1.0: 2 ports detected gitlab # [ 2.336213] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.338348] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.339798] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.341004] scsi host0: ata_piix gitlab # [ 2.341928] scsi host1: ata_piix gitlab # [ 2.342530] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.343724] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.235930] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.250115] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.251144] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.251984] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.256882] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.261818] systemd-vconsole-setup[149]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.263946] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.280848] systemd-fsck[154]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.285104] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.506286] ata2: found unknown device (class 0) gitlab # [ 2.509349] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.514068] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.554034] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.555034] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.426741] (udev-worker)[138]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.430998] (udev-worker)[128]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.436729] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.602350] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.635683] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.725230] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.728788] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.731533] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.733247] usb 1-1: Manufacturer: QEMU gitlab # [ 2.734774] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.765830] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.780105] usbcore: registered new interface driver usbhid gitlab # [ 2.782250] usbhid: USB HID core driver gitlab # [ 2.791616] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.795129] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.914123] systemd[1]: Mounting /sysroot... gitlab # [ 3.220952] EXT4-fs (vda): mounted filesystem 86558f25-be50-4841-956c-2ae55af051a1 r/w with ordered data mode. Quota mode: none. gitlab # [ 3.081370] systemd[1]: Mounted /sysroot. gitlab # [ 3.082558] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.086513] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.088538] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.092122] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.093952] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.101821] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.106060] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.260439] 9p: Installing v9fs 9p2000 file system support gitlab # [ 3.114505] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.115719] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.123055] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.124067] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.273370] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.129218] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.132450] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.133426] systemd-sysroot-fstab-check[176]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.136067] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.137368] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.138837] systemd[1]: Reload requested from client PID 176 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.140325] systemd[1]: Reloading... gitlab # [ 3.203085] systemd[1]: Reloading finished in 61 ms. gitlab # [ 3.223478] systemd-sysroot-fstab-check[176]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.226540] systemd-sysroot-fstab-check[176]: Requesting swap.target/start/replace... gitlab # [ 3.229539] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.231810] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.234424] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.236742] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.252658] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.255249] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.915089] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.972159] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.974295] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.976294] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.978471] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 4.009452] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 4.012704] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 4.028202] systemd[1]: Finished Find NixOS closure. gitlab # [ 4.030231] systemd[1]: Reached target Initrd Default Target. gitlab # [ 4.032551] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.063755] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.065794] systemd[1]: Stopped target Basic System. gitlab # [ 4.067540] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.069448] systemd[1]: Stopped target Path Units. gitlab # [ 4.071178] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.073612] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.076220] systemd[1]: Stopped target Slice Units. gitlab # [ 4.077951] systemd[1]: Stopped target Socket Units. gitlab # [ 4.079752] systemd[1]: Stopped target System Initialization. gitlab # [ 4.082190] systemd[1]: Stopped target Swaps. gitlab # [ 4.085073] systemd[1]: Stopped target Timer Units. gitlab # [ 4.086975] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.091470] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.094355] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.097457] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.098886] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.101885] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.103609] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.105507] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.107164] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.109216] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.110593] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.112639] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.114693] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.116517] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.117715] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.118802] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.120055] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.121456] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.122555] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.123937] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.125229] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.126247] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.127475] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.128609] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.129610] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.130436] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.131352] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.132346] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.133359] systemd[1]: Closed udev Control Socket. gitlab # [ 4.134106] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.134889] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.135984] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.136893] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.138043] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.139050] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.140486] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.150639] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.151885] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.152658] systemd[1]: Reached target Switch Root. gitlab # [ 4.153390] systemd[1]: Starting NixOS Activation... gitlab # [ 4.284757] initrd-nixos-activation-start[225]: booting system configuration /nix/store/5fzqssb8bl6z091k7ahcaxag1sfxy70b-nixos-system-gitlab-test gitlab # [ 4.329578] initrd-nixos-activation-start[225]: running activation script... gitlab # [ 4.594461] initrd-nixos-activation-start[248]: setting up /etc... gitlab # [ 4.693601] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.696481] systemd[1]: Finished NixOS Activation. gitlab # [ 4.698327] systemd[1]: Starting Switch Root... gitlab # [ 4.735514] systemd[1]: Switching root. gitlab # [ 4.944358] systemd-journald[92]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.070087] NET: Registered PF_VSOCK protocol family gitlab # [ 5.452056] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.462499] systemd[1]: Detected virtualization kvm. gitlab # [ 5.464402] systemd[1]: Detected architecture x86-64. gitlab # [ 5.466375] systemd[1]: Detected first boot. gitlab # [ 5.468861] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.611560] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.712494] systemd[1]: Applying preset policy. gitlab # [ 5.908433] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.034934] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.036326] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.039025] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.041460] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.042811] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.044486] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.045443] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.046692] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.047943] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.048705] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 6.049571] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.050434] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.051208] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.052109] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.053150] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.054137] systemd[1]: Reached target Path Units. gitlab # [ 6.054870] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.055735] systemd[1]: Reached target Slice Units. gitlab # [ 6.056470] systemd[1]: Reached target Swaps. gitlab # [ 6.058177] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.060290] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.061722] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.063345] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.064328] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.067006] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.068513] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.070631] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.071856] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.073131] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.074587] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.077345] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.078490] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.079438] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.082772] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.084997] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.087377] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.090969] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.105926] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.107053] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 6.111767] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 6.112691] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.114630] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.117287] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.136998] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.138985] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.144156] systemd[1]: Starting Journal Service... gitlab # [ 6.146278] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.164353] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.167975] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.169014] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.174156] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.179572] systemd-journald[319]: Collecting audit messages is enabled. gitlab # [ 6.181703] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.182767] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.183807] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.185146] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.186210] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.188388] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.189689] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 6.191231] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 6.192373] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.195129] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.201335] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.202629] EXT4-fs (vda): re-mounted 86558f25-be50-4841-956c-2ae55af051a1. gitlab # [ 6.060112] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.064031] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 6.211617] loop: module loaded gitlab # [ 6.066119] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 6.067515] systemd-modules-load[320]: Using 3 probe threads gitlab # [ 6.214509] systemd[1]: Started Journal Service. gitlab # [ 6.068709] systemd-modules-load[320]: Inserted module 'tls' gitlab # [ 6.069979] systemd-modules-load[320]: Inserted module 'loop' gitlab # [ 6.071182] systemd[1]: Finished Load Kernel Modules. gitlab # [ 6.072238] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.073679] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.080209] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.082226] systemd[1]: Starting Firewall... gitlab # [ 6.084234] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.085398] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.090233] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.094142] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.095727] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.097230] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.104921] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.106394] systemd-oomd[321]: No swap; memory pressure usage will be degraded gitlab # [ 6.254954] systemd-journald[319]: Received client request to flush runtime journal. gitlab # [ 6.150567] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.152986] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.153962] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.154970] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.155717] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.156603] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.157611] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.158670] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.168023] systemd-udevd[352]: Using default interface naming scheme 'v261'. gitlab # [ 6.197409] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 6.206403] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.288729] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.307197] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.347143] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.359052] (udev-worker)[416]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.360579] (udev-worker)[420]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.362830] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.378706] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.380137] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.381844] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.384187] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.385851] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.387134] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.536824] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.556667] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.559955] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.561250] ACPI: button: Power Button [PWRF] gitlab # [ 6.575105] Console: switching to colour dummy device 80x25 gitlab # [ 6.577763] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.577765] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.580772] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 6.583075] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.584007] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.592364] FDC 0 is a S82078B gitlab # [ 6.596447] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.597711] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.454352] systemd[1]: Finished Firewall. gitlab # [ 6.606789] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.614795] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.615135] rtc_cmos 00:05: setting system clock to 2026-10-06T14:46:20 UTC (1791297980) gitlab # [ 6.616062] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.621266] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.623791] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.624224] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4 gitlab # [ 6.624420] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.624777] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.638586] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 gitlab # [ 6.641419] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.535231] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.545376] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.547724] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.549430] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.698852] ppdev: user-space parallel port driver gitlab # [ 6.553604] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.554739] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.555568] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.629883] systemd-vconsole-setup[491]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.631940] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.825537] kvm_amd: TSC scaling supported gitlab # [ 6.826125] kvm_amd: Nested Virtualization enabled gitlab # [ 6.826650] kvm_amd: Nested Paging enabled gitlab # [ 6.827125] kvm_amd: LBR virtualization supported gitlab # [ 6.827663] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.828244] kvm_amd: Virtual GIF supported gitlab # [ 6.828683] kvm_amd: Virtual NMI enabled gitlab # [ 6.865711] EDAC MC: Ver: 3.0.0 gitlab # [ 6.893510] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.920291] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.922131] systemd[1]: Reached target Local File Systems. gitlab # [ 6.924055] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.926494] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.928935] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.931190] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.934444] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.936680] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.976950] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.979503] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.983389] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.988674] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.991480] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.014462] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.028209] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.031251] systemd[1]: Starting Update is Completed... gitlab # [ 7.045815] systemd[1]: Finished Update is Completed. gitlab # [ 7.086601] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.088053] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.402505] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.404369] systemd[1]: Reached target System Initialization. gitlab # [ 7.405968] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.407982] systemd[1]: Started logrotate.timer. gitlab # [ 7.409278] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.411108] systemd[1]: Reached target Timer Units. gitlab # [ 7.412436] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.414197] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.415617] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.417207] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.419659] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.421235] systemd[1]: Reached target Socket Units. gitlab # [ 7.422553] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.499770] dbus-broker-launch[573]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.502648] dbus-broker-launch[573]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.505266] dbus-broker-launch[573]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.510814] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.530526] dbus-broker-launch[573]: Ready gitlab # [ 7.533282] systemd[1]: Reached target Basic System. gitlab # [ 7.536440] systemd[1]: Started backdoor.service. gitlab # [ 7.540159] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.547597] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.554456] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.562950] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.565651] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.571565] systemd[1]: Started Reset console on configuration changes. gitlab # [ 7.577690] systemd[1]: Starting resolvconf update... gitlab # connecting to host... gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab: connected to guest root shell gitlab # [ 7.597460] logrotate[578]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab: (connecting took 8.29 seconds) gitlab # [ 7.598149] logrotate[578]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab: (finished: waiting for the VM to finish booting, in 8.29 seconds) gitlab # [ 7.598823] logrotate[578]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.599413] logrotate[578]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.599886] logrotate[578]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.600389] logrotate[578]: Allocating hash table for state file, size 64 entries gitlab # [ 7.600904] logrotate[578]: Handling 4 logs gitlab # [ 7.601453] logrotate[578]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.601922] logrotate[578]: considering log /var/log/btmp gitlab # [ 7.602495] logrotate[578]: Creating new state gitlab # [ 7.602960] logrotate[578]: Now: 2026-10-06 14:46 gitlab # [ 7.603545] logrotate[578]: Last rotated at 2026-10-06 14:00 gitlab # [ 7.605299] logrotate[578]: log does not need rotating (log has already been rotated) gitlab # [ 7.606445] logrotate[578]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.607135] logrotate[578]: considering log /var/log/wtmp gitlab # [ 7.607563] logrotate[578]: Creating new state gitlab # [ 7.608090] logrotate[578]: Now: 2026-10-06 14:46 gitlab # [ 7.608582] logrotate[578]: Last rotated at 2026-10-06 14:00 gitlab # [ 7.610638] logrotate[578]: log does not need rotating (log has already been rotated) gitlab # [ 7.611500] logrotate[578]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.611730] logrotate[578]: switching euid from 0 to 165 and egid from 0 to 165 (pid 578) gitlab # [ 7.612404] logrotate[578]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.612701] logrotate[578]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.613372] logrotate[578]: Creating new state gitlab # [ 7.613883] logrotate[578]: switching euid from 165 to 0 and egid from 165 to 0 (pid 578) gitlab # [ 7.615700] logrotate[578]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.616244] logrotate[578]: switching euid from 0 to 60 and egid from 0 to 60 (pid 578) gitlab # [ 7.616669] logrotate[578]: considering log /var/log/nginx/*.log gitlab # [ 7.617194] logrotate[578]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.617689] logrotate[578]: Creating new state gitlab # [ 7.618204] logrotate[578]: not running postrotate script, since no logs were rotated gitlab # [ 7.618725] logrotate[578]: switching euid from 60 to 0 and egid from 60 to 0 (pid 578) gitlab # [ 7.619343] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.619910] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.638158] nsncd[579]: Oct 06 14:46:21.669 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.645200] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.646194] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.647315] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.649108] systemd[1]: Starting User Login Management... gitlab # [ 7.650633] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.659822] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.660607] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.661671] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.662495] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.662977] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.664358] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.666295] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.666902] systemd[1]: nscd.service: Consumed 20ms CPU time over 102ms wall clock time, 7.2M memory peak, 5.5M read from disk. gitlab # [ 7.674205] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.692394] nsncd[670]: Oct 06 14:46:21.723 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.692967] systemd[1]: Finished resolvconf update. gitlab # [ 7.693639] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.693972] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.694661] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.695246] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.696300] systemd[1]: Starting DHCP Client... gitlab # [ 7.699742] systemd-logind[643]: New seat seat0. gitlab # [ 7.701928] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.704082] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.706723] systemd-logind[643]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.707291] systemd-logind[643]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 7.708065] systemd-logind[643]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.710223] systemd[1]: Started User Login Management. gitlab # [ 7.714419] systemd[1]: Starting linger-users.service... gitlab # [ 7.732026] network-addresses-eth1-start[693]: adding address 192.168.1.1/24... done gitlab # [ 7.733640] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.734560] systemd[1]: Finished linger-users.service. gitlab # [ 7.737584] network-addresses-eth1-start[693]: adding address 2001:db8:1::1/64... done gitlab # [ 7.743553] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.779345] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.782058] systemd[1]: Reached target Network. gitlab # [ 7.783545] dhcpcd[707]: dhcpcd-10.3.2 starting gitlab # [ 7.784476] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.787734] dhcpcd[762]: dev: loaded udev gitlab # [ 7.788496] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.790868] systemd[1]: Starting PostgreSQL Server... gitlab # [ 7.941455] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.942162] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 7.796170] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 7.798553] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.808090] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.822412] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.829072] systemd[1]: Started Getty on tty1. gitlab # [ 7.831048] systemd[1]: Reached target Login Prompts. gitlab # [ 8.044132] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.049965] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.050826] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.052387] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.053438] cfg80211: failed to load regulatory.db gitlab # [ 7.923333] nginx-pre-start[784]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.923738] nginx-pre-start[784]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.930105] systemd[1]: Started Nginx Web Server. gitlab # [ 8.085159] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.940263] dhcpcd[762]: eth0: waiting for carrier gitlab # [ 7.941733] dhcpcd[762]: eth0: carrier acquired gitlab # [ 7.944749] dhcpcd[762]: DUID 00:01:00:01:32:57:c6:3d:52:54:00:12:34:56 gitlab # [ 7.945761] dhcpcd[762]: eth0: IAID 00:12:34:56 gitlab # [ 7.946411] dhcpcd[762]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.963806] postgresql-pre-start[789]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.964578] postgresql-pre-start[789]: This user must also own the server process. gitlab # [ 7.967296] redis-server[785]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.968085] redis-server[785]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.968839] redis-server[785]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=785, just started gitlab # [ 7.970345] redis-server[785]: Configuration loaded gitlab # [ 7.973161] dhcpcd[762]: eth0: soliciting a DHCP lease gitlab # [ 7.975105] redis[785]: monotonic clock: POSIX clock_gettime gitlab # [ 7.975809] postgresql-pre-start[789]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.976719] postgresql-pre-start[789]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.977541] postgresql-pre-start[789]: The default text search configuration will be set to "english". gitlab # [ 7.978086] postgresql-pre-start[789]: Data page checksums are enabled. gitlab # [ 7.978633] postgresql-pre-start[789]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.979137] postgresql-pre-start[789]: creating subdirectories ... ok gitlab # [ 7.979625] postgresql-pre-start[789]: selecting dynamic shared memory implementation ... posix gitlab # [ 8.131048] NET: Registered PF_PACKET protocol family gitlab # [ 7.986133] redis[785]: Running mode=standalone, port=0. gitlab # [ 7.987687] redis[785]: Server initialized gitlab # [ 7.988575] redis[785]: Ready to accept connections unix gitlab # [ 7.989262] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.990420] redis[785]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.992928] dhcpcd[762]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 7.996219] dhcpcd[762]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.011658] postgresql-pre-start[789]: selecting default "max_connections" ... 100 gitlab # [ 8.061430] postgresql-pre-start[789]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.316449] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.476549] postgresql-pre-start[789]: selecting default time zone ... UTC gitlab # [ 8.478445] postgresql-pre-start[789]: creating configuration files ... ok gitlab # [ 8.544456] gitlab-workhorse[822]: time="2026-10-06T14:46:22Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.545214] gitlab-workhorse[822]: time="2026-10-06T14:46:22Z" level=info msg="Using redis/go-redis" gitlab # [ 8.545687] gitlab-workhorse[822]: time="2026-10-06T14:46:22Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.651973] postgresql-pre-start[789]: running bootstrap script ... ok gitlab # [ 9.116985] postgresql-pre-start[789]: performing post-bootstrap initialization ... ok gitlab # [ 9.352073] postgresql-pre-start[789]: syncing data to disk ... ok gitlab # [ 9.353974] postgresql-pre-start[789]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 9.355296] postgresql-pre-start[789]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 9.356451] postgresql-pre-start[789]: Success. You can now start the database server using: gitlab # [ 9.358076] postgresql-pre-start[789]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 9.493422] postgres[846]: [846] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 9.497483] postgres[846]: [846] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 9.500517] postgres[846]: [846] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 9.503629] postgres[846]: [846] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 9.511404] postgres[860]: [860] LOG: database system was shut down at 2026-10-06 14:46:23 GMT gitlab # [ 9.518734] postgres[846]: [846] LOG: database system is ready to accept connections gitlab # [ 9.525558] systemd[1]: Started PostgreSQL Server. gitlab # [ 9.529690] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 9.643777] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[854]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 9.647166] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[854]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 9.699873] postgresql-setup-start[872]: CREATE DATABASE gitlab # [ 9.711955] systemd[1]: Finished gitlab-config.service. gitlab # [ 9.715356] systemd[1]: Started gitaly.service. gitlab # [ 9.719676] postgresql-setup-start[888]: CREATE ROLE gitlab # [ 9.736591] postgresql-setup-start[896]: ALTER DATABASE gitlab # [ 9.758493] postgresql-setup-start[907]: CREATE ROLE gitlab # [ 9.760830] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 9.762889] systemd[1]: Reached target PostgreSQL. gitlab # [ 9.765954] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 9.767465] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.868750] gitlab-postgresql-start[917]: CREATE DATABASE gitlab # [ 9.904424] gitlab-postgresql-start[922]: CREATE EXTENSION gitlab # [ 9.991652] gitlab-postgresql-start[924]: CREATE EXTENSION gitlab # [ 9.997938] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 10.245142] gitaly[891]: time="2026-10-06T14:46:24.276Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=891 gitlab # [ 10.246453] gitaly[891]: time="2026-10-06T14:46:24.276Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=891 gitlab # [ 10.247296] gitaly[891]: time="2026-10-06T14:46:24.276Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=891 gitlab # [ 10.248089] gitaly[891]: time="2026-10-06T14:46:24.276Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=891 gitlab # [ 10.248737] gitaly[891]: time="2026-10-06T14:46:24.276Z" level=info msg="Starting Gitaly" pid=891 version= gitlab # [ 10.315878] dhcpcd[762]: eth0: soliciting an IPv6 router gitlab # [ 10.316975] dhcpcd[762]: eth0: Router Advertisement from fe80::2 gitlab # [ 10.317734] dhcpcd[762]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 10.318585] dhcpcd[762]: eth0: adding route to fec0::/64 gitlab # [ 10.319159] dhcpcd[762]: eth0: adding default route via fe80::2 gitlab # [ 10.444304] gitaly[891]: time="2026-10-06T14:46:24.476Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=188 pid=891 gitlab # [ 10.445368] gitaly[891]: time="2026-10-06T14:46:24.476Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=891 gitlab # [ 10.448202] gitaly[891]: time="2026-10-06T14:46:24.480Z" level=info msg="finished initializing command factory" duration_ms=3 pid=891 gitlab # [ 10.448941] gitaly[891]: time="2026-10-06T14:46:24.480Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-891/git-exec-3134435211.d/git pid=891 gitlab # [ 10.456622] gitaly[891]: time="2026-10-06T14:46:24.488Z" level=info msg="finished detecting git version" duration_ms=8 pid=891 gitlab # [ 10.457171] gitaly[891]: time="2026-10-06T14:46:24.488Z" level=info msg="using Git version" pid=891 version=2.53.g gitlab # [ 10.457517] gitaly[891]: time="2026-10-06T14:46:24.489Z" level=info msg="clearing disk cache object folder" pid=891 storage=default gitlab # [ 10.458200] gitaly[891]: time="2026-10-06T14:46:24.489Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3919421819 pid=891 storage=default gitlab # [ 10.459084] gitaly[891]: time="2026-10-06T14:46:24.489Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3919421819 pid=891 storage=default gitlab # [ 10.459746] gitaly[891]: time="2026-10-06T14:46:24.489Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=891 gitlab # [ 10.460508] gitaly[891]: time="2026-10-06T14:46:24.489Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=891 gitlab # [ 10.461181] gitaly[891]: time="2026-10-06T14:46:24.490Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3919421819 clear_duration_ms=0 pid=891 storage=default gitlab # [ 10.497187] gitaly[891]: time="2026-10-06T14:46:24.528Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=891 gitlab # [ 10.497910] gitaly[891]: time="2026-10-06T14:46:24.528Z" level=info msg="counting repositories" pid=891 gitlab # [ 10.498569] gitaly[891]: time="2026-10-06T14:46:24.529Z" level=info msg="starting to count repositories" pid=891 storage_path=/var/gitlab/state/repositories gitlab # [ 10.499152] gitaly[891]: time="2026-10-06T14:46:24.529Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=891 storage_path=/var/gitlab/state/repositories gitlab # [ 10.499785] gitaly[891]: time="2026-10-06T14:46:24.529Z" level=info msg="completed counting all repositories" counting_duration=0 pid=891 gitlab # [ 10.499988] gitaly[891]: time="2026-10-06T14:46:24.528Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=891 schema=unix gitlab # [ 10.500543] gitaly[891]: time="2026-10-06T14:46:24.529Z" level=info msg="listening at address" address=/run/gitaly/gitaly-891/sock.d/intern pid=891 schema=unix gitlab # [ 10.500741] gitaly[891]: time="2026-10-06T14:46:24.531Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=891 gitlab # [ 10.501445] gitaly[891]: time="2026-10-06T14:46:24.531Z" level=info msg="Started Gitaly" duration_ms=254 pid=891 gitlab # [ 10.502107] gitaly[891]: time="2026-10-06T14:46:24.531Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=891 gitlab # [ 10.516083] gitaly[891]: time="2026-10-06T14:46:24.528Z" level=info msg="finished tempdir cleaner walk" pid=891 storage=default time_ms=0 gitlab # [ 10.516859] gitaly[891]: time="2026-10-06T14:46:24.547Z" level=info msg="maintenance: daily scheduled" pid=891 scheduled="2026-10-07 12:00:00 +0000 UTC" gitlab # [ 11.402604] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.406514] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.434654] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.488866] gitaly[891]: time="2026-10-06T14:46:26.519Z" level=info msg="License database preloaded" duration_ms=2242 pid=891 gitlab # [ 12.775547] dhcpcd[762]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 12.775944] dhcpcd[762]: eth0: adding route to 10.0.2.0/24 gitlab # [ 12.776413] dhcpcd[762]: eth0: adding default route via 10.0.2.2 gitlab # [ 12.895188] systemd[1]: Started DHCP Client. gitlab # [ 12.895951] systemd[1]: Reached target Network is Online. gitlab # [ 43.520138] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[912]: W, [2026-10-06T14:46:57.551102 #912] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 45.685934] postgres[1331]: [1331] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 45.687562] postgres[1331]: [1331] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 45.687854] postgres[1331]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 45.690105] postgres[1331]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 45.691232] postgres[1331]: attidentity AS identity, gitlab # [ 45.692368] postgres[1331]: attgenerated as attgenerated gitlab # [ 45.693874] postgres[1331]: FROM pg_attribute a gitlab # [ 45.695371] postgres[1331]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 45.696883] postgres[1331]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 45.698371] postgres[1331]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 45.699882] postgres[1331]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 45.701405] postgres[1331]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 45.702988] postgres[1331]: ORDER BY a.attnum gitlab # [ 45.703746] postgres[1331]: gitlab # [ 48.582139] gitlab-workhorse[822]: time="2026-10-06T14:47:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 49.542405] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1364]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 49.544818] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1364]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 58.583577] gitlab-workhorse[822]: time="2026-10-06T14:47:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 65.311296] postgres[1439]: [1439] ERROR: relation "table_without_models" does not exist gitlab # [ 65.312578] postgres[1439]: [1439] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.592305] gitlab-workhorse[822]: time="2026-10-06T14:47:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 77.724938] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 77.731750] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 77.737419] systemd[1]: Starting gitlab.service... gitlab # [ 78.110898] bundle[1615]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 78.112225] bundle[1615]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 78.115934] bundle[1615]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 78.602785] gitlab-workhorse[822]: time="2026-10-06T14:47:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 80.981592] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-10-06T14:47:34.995Z","message":"Starting cluster with 1 processes"} gitlab # [ 81.094952] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.105Z","pid":1615,"message":"* Enabling systemd notification integration"} gitlab # [ 81.096068] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"Puma starting in cluster mode..."} gitlab # [ 81.096920] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 81.097827] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 81.098532] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Min threads: 0"} gitlab # [ 81.099518] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Max threads: 4"} gitlab # [ 81.100145] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Environment: production"} gitlab # [ 81.101059] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Master PID: 1615"} gitlab # [ 81.101754] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Workers: 2"} gitlab # [ 81.102472] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 81.103216] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Preloading application"} gitlab # [ 88.613074] gitlab-workhorse[822]: time="2026-10-06T14:47:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.623493] gitlab-workhorse[822]: time="2026-10-06T14:47:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 105.316656] bundle[1615]: W, [2026-10-06T14:47:59.347556 #1615] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 108.167575] sidekiq-cluster[1645]: 2026-10-06T14:48:02.198Z pid=1645 tid=wjp INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1645, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>438460416} gitlab # [ 108.347890] sidekiq-cluster[1645]: W, [2026-10-06T14:48:02.379480 #1645] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 108.388585] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:02.420Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 108.633642] gitlab-workhorse[822]: time="2026-10-06T14:48:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 110.582477] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.613Z","message":"GitLab reliable fetch activated!"} gitlab # [ 110.583798] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.613Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 110.637737] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.669Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 110.643443] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.675Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 110.655945] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.687Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 110.661200] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.693Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 110.666418] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.698Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 110.672109] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.703Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 110.679351] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.711Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 110.685092] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.716Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 110.690834] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.722Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 110.696671] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.728Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 110.704804] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.736Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 110.710147] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.741Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 110.713847] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.745Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 110.719350] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.751Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 110.725364] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.757Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 110.731651] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.763Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 110.738899] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.770Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 110.745584] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.777Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 110.753167] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.784Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 110.759864] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.791Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 110.768321] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.799Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 110.775556] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.807Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 110.781826] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.813Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 110.788923] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.820Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 110.795111] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.826Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 110.801902] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.833Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 110.808634] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.840Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 110.815357] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.847Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 110.822312] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.854Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 110.828519] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.860Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 110.834184] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.865Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 110.842490] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.874Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 110.850315] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.882Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 110.857266] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.889Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 110.863723] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.895Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 110.869602] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.901Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 110.875289] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.907Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 110.881659] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.913Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 110.886701] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.918Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 110.891600] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.923Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 110.896957] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.928Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 110.901934] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.933Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 110.909703] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.941Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 110.915729] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.947Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 110.922485] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.954Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 110.929049] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.960Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 110.934644] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.966Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 110.940723] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.972Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 110.947392] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.979Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 110.953371] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.985Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 110.959577] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.991Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 110.966365] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.998Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 110.986221] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.017Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 110.992872] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.024Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 111.000585] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.032Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 111.011099] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.042Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 111.019424] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.051Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 111.028622] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.060Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 111.036111] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.067Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 111.044615] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.076Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 111.052486] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.084Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 111.059757] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.091Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 111.068488] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.100Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 111.077447] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.109Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 111.086095] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.117Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 111.122265] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.152Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 111.132637] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.164Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 111.141662] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.173Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 111.150919] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.182Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 111.160197] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.191Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 111.172169] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.203Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 111.181122] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.212Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 111.192151] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.223Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 111.201808] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.233Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 111.212219] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.243Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 111.221347] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.253Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 111.231797] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.263Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 111.242237] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.273Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 111.251686] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.283Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 111.260337] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.292Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 111.269425] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.301Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 111.279698] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.311Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 111.290340] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.322Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 111.299421] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.331Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 111.307907] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.339Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 111.318545] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.350Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 111.328055] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.359Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 111.337247] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.368Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 111.345449] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.377Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 111.354667] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.386Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 111.362291] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.394Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 111.370226] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.401Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 111.378795] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.410Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 111.386760] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.418Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 111.395743] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.427Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 111.404729] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.436Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 111.413112] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.444Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 111.420906] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.452Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 111.446309] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.478Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 111.454543] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.486Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 111.463072] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.494Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 111.473909] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.505Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 111.483942] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.515Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 111.493496] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.525Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 111.504087] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.535Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 111.512788] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.544Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 111.521485] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.552Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 111.533514] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.565Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 111.542107] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.573Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 118.644163] gitlab-workhorse[822]: time="2026-10-06T14:48:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 128.645925] gitlab-workhorse[822]: time="2026-10-06T14:48:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 133.958960] postgres[2138]: [2138] ERROR: relation "table_without_models" does not exist gitlab # [ 133.959672] postgres[2138]: [2138] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 135.865830] postgres[2149]: [2149] ERROR: relation "table_without_models" does not exist gitlab # [ 135.866913] postgres[2149]: [2149] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 136.479137] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:30.510Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 136.485072] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:30.516Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 136.489175] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:30.516Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 136.490974] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:30.516Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 136.494165] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:30.519Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 138.301405] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:32.332Z","message":"Cleaning working queues"} gitlab # [ 138.304594] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:32.335Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b3f2608f475fd7282adaf2c7","created_at":"2026-10-06T14:47:31.344Z","trace_propagation_headers":{"sentry-trace":"5469ca743a8d4ab5b550a30a3e9b5998-fed5049425114a62","baggage":"sentry-trace_id=5469ca743a8d4ab5b550a30a3e9b5998,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1fe1098dfe148eaf9c62b8f7fd86f7f2","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-06T14:47:31.352Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b3f2608f475fd7282adaf2c7: start","job_status":"start","queue_duration_s":60.98304,"scheduling_latency_s":60.983111} gitlab # [ 138.497538] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:32.528Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b3f2608f475fd7282adaf2c7","created_at":"2026-10-06T14:47:31.344Z","trace_propagation_headers":{"sentry-trace":"5469ca743a8d4ab5b550a30a3e9b5998-fed5049425114a62","baggage":"sentry-trace_id=5469ca743a8d4ab5b550a30a3e9b5998,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1fe1098dfe148eaf9c62b8f7fd86f7f2","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-06T14:47:31.352Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b3f2608f475fd7282adaf2c7: done: 0.192943 sec","job_status":"done","queue_duration_s":60.98304,"scheduling_latency_s":60.983111,"redis_calls":31,"redis_duration_s":0.008117,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.004593,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002203,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.096561714,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.192943,"completed_at":"2026-10-06T14:48:32.528Z","load_balancing_strategy":"primary","db_duration_s":0.063579,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 138.647253] gitlab-workhorse[822]: time="2026-10-06T14:48:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 138.882913] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.913Z","pid":1615,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 138.884454] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.914Z","pid":1615,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 138.885947] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.914Z","pid":1615,"message":"! #\u003cThread:0x0000727c94e5d818 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 138.887503] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.914Z","pid":1615,"message":"! #\u003cThread:0x0000727c9505c650 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 138.888212] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.914Z","pid":1615,"message":"Use Ctrl-C to stop"} gitlab # [ 138.889336] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.914Z","pid":1615,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 139.697663] bundle[1615]: {"timestamp":"2026-10-06T14:48:33.729Z","pid":1615,"message":"- Worker 0 (PID: 2212) booted in 0.75s, phase: 0"} gitlab # [ 139.723393] bundle[1615]: {"timestamp":"2026-10-06T14:48:33.755Z","pid":1615,"message":"- Worker 1 (PID: 2216) booted in 0.75s, phase: 0"} gitlab # [ 139.728294] systemd[1]: Started gitlab.service. gitlab # [ 139.729047] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 139.732742] systemd[1]: Starting setup-gitlab.service... gitlab # [ 139.751133] setup-gitlab-start[2249]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 142.097988] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:48:36 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 2314 gitlab # [ 142.104085] setup-gitlab-start[2249]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 142.106612] setup-gitlab-start[2249]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 142.120561] runuser[2267]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 142.492494] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 142.494219] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 142.495331] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 143.081184] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 143.083398] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 143.085506] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 169.022198] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b0deafca26b3facf6bccbe37","created_at":"2026-10-06T14:49:02.971Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea439cfd6ff374cb6aa293af6d85172e","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.049Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b0deafca26b3facf6bccbe37: start","job_status":"start","queue_duration_s":0.002742,"scheduling_latency_s":0.002801} gitlab # [ 169.151571] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b0deafca26b3facf6bccbe37","created_at":"2026-10-06T14:49:02.971Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea439cfd6ff374cb6aa293af6d85172e","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.049Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b0deafca26b3facf6bccbe37: done: 0.130509 sec","job_status":"done","queue_duration_s":0.002742,"scheduling_latency_s":0.002801,"redis_calls":13,"redis_duration_s":0.013612,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003636,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.006126,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00385,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0129631,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.130509,"completed_at":"2026-10-06T14:49:03.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019023,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 169.222085] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3b942d42c78f6f426a6e4931","created_at":"2026-10-06T14:49:03.093Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"018e6eb878f2bd5c13c21cce122895bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-06T14:49:03.107Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3b942d42c78f6f426a6e4931: start","job_status":"start","queue_duration_s":0.079591,"scheduling_latency_s":0.079607} gitlab # [ 169.234270] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.195Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 169.237853] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3b942d42c78f6f426a6e4931","created_at":"2026-10-06T14:49:03.093Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"018e6eb878f2bd5c13c21cce122895bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-06T14:49:03.107Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3b942d42c78f6f426a6e4931: done: 0.013251 sec","job_status":"done","queue_duration_s":0.079591,"scheduling_latency_s":0.079607,"redis_calls":10,"redis_duration_s":0.001905,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257854,"duration_s":0.013251,"completed_at":"2026-10-06T14:49:03.199Z","load_balancing_strategy":"primary","db_duration_s":0.000305,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.275877] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ea3dbe3c836f89d8107e065c","created_at":"2026-10-06T14:49:03.118Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"257e03ef0952352853eadd5ea6986a59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.127Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ea3dbe3c836f89d8107e065c: start","job_status":"start","queue_duration_s":0.073992,"scheduling_latency_s":0.074005} gitlab # [ 169.289557] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ea3dbe3c836f89d8107e065c","created_at":"2026-10-06T14:49:03.118Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"257e03ef0952352853eadd5ea6986a59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.127Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ea3dbe3c836f89d8107e065c: done: 0.01372 sec","job_status":"done","queue_duration_s":0.073992,"scheduling_latency_s":0.074005,"redis_calls":12,"redis_duration_s":0.0027419999999999996,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00121,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000423,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000273498,"duration_s":0.01372,"completed_at":"2026-10-06T14:49:03.214Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.311320] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e555e9491133d58a98023c10","created_at":"2026-10-06T14:49:03.131Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83f93e39dce67efa0292e30219209ef2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.139Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e555e9491133d58a98023c10: start","job_status":"start","queue_duration_s":0.077367,"scheduling_latency_s":0.077419} gitlab # [ 169.344150] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e555e9491133d58a98023c10","created_at":"2026-10-06T14:49:03.131Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83f93e39dce67efa0292e30219209ef2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.139Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e555e9491133d58a98023c10: done: 0.158833 sec","job_status":"done","queue_duration_s":0.077367,"scheduling_latency_s":0.077419,"redis_calls":14,"redis_duration_s":0.004443,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000933,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001996,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001514,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047073,"exclusive_lock_hold_duration_s":0.109109398,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.158833,"completed_at":"2026-10-06T14:49:03.375Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.107901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.394520] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.425Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6995c22d505b328c61c38949","created_at":"2026-10-06T14:49:03.149Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6f50acb04f15a406f78b8d49d811831","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.167Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6995c22d505b328c61c38949: start","job_status":"start","queue_duration_s":0.25825,"scheduling_latency_s":0.258294} gitlab # [ 169.460561] setup-gitlab-start[2268]: W, [2026-10-06T14:49:03.491595 #2268] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 169.499750] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.530Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6995c22d505b328c61c38949","created_at":"2026-10-06T14:49:03.149Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6f50acb04f15a406f78b8d49d811831","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.167Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6995c22d505b328c61c38949: done: 0.105058 sec","job_status":"done","queue_duration_s":0.25825,"scheduling_latency_s":0.258294,"redis_calls":16,"redis_duration_s":0.01685,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.004516,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001180597,"duration_s":0.105058,"completed_at":"2026-10-06T14:49:03.530Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.550251] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a31229a60dda065b889ce1fa","created_at":"2026-10-06T14:49:03.180Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80b5748d774b1bc1242eb23685e35ed1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-06T14:49:03.233Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a31229a60dda065b889ce1fa: start","job_status":"start","queue_duration_s":0.34774,"scheduling_latency_s":0.34779} gitlab # [ 169.619118] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a31229a60dda065b889ce1fa","created_at":"2026-10-06T14:49:03.180Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80b5748d774b1bc1242eb23685e35ed1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-06T14:49:03.233Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a31229a60dda065b889ce1fa: done: 0.06968 sec","job_status":"done","queue_duration_s":0.34774,"scheduling_latency_s":0.34779,"redis_calls":10,"redis_duration_s":0.006699999999999999,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001022,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002861,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000630527,"duration_s":0.06968,"completed_at":"2026-10-06T14:49:03.650Z","load_balancing_strategy":"primary","db_duration_s":0.012633,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.667732] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d40e3f476ea0e43e1c569630","created_at":"2026-10-06T14:49:03.238Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3510ac685b253d42b68459fbcd2b5f94","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.263Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d40e3f476ea0e43e1c569630: start","job_status":"start","queue_duration_s":0.435323,"scheduling_latency_s":0.435364} gitlab # [ 169.946853] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d40e3f476ea0e43e1c569630","created_at":"2026-10-06T14:49:03.238Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3510ac685b253d42b68459fbcd2b5f94","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.263Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d40e3f476ea0e43e1c569630: done: 0.279177 sec","job_status":"done","queue_duration_s":0.435323,"scheduling_latency_s":0.435364,"redis_calls":12,"redis_duration_s":0.004133,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000687,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.039,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.204311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001485943,"exclusive_lock_hold_duration_s":0.235044678,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.279177,"completed_at":"2026-10-06T14:49:03.978Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.064687,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.988422] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f2d476532d2f74461df0c398","created_at":"2026-10-06T14:49:03.268Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b83d4f9522fc6d0d1876af0e66bdf2f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.280Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f2d476532d2f74461df0c398: start","job_status":"start","queue_duration_s":0.739139,"scheduling_latency_s":0.739167} gitlab # [ 170.034218] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f2d476532d2f74461df0c398","created_at":"2026-10-06T14:49:03.268Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b83d4f9522fc6d0d1876af0e66bdf2f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.280Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f2d476532d2f74461df0c398: done: 0.044778 sec","job_status":"done","queue_duration_s":0.739139,"scheduling_latency_s":0.739167,"redis_calls":10,"redis_duration_s":0.002916,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00053,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001856,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000510959,"duration_s":0.044778,"completed_at":"2026-10-06T14:49:04.064Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.075479] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.106Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1c2325ebcfe5d5ac6e084897","created_at":"2026-10-06T14:49:03.286Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30e83f33d9223af5b4c7be74666d5794","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.289Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1c2325ebcfe5d5ac6e084897: start","job_status":"start","queue_duration_s":0.816715,"scheduling_latency_s":0.81677} gitlab # [ 170.095438] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.127Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 170.106779] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1c2325ebcfe5d5ac6e084897","created_at":"2026-10-06T14:49:03.286Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30e83f33d9223af5b4c7be74666d5794","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.289Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1c2325ebcfe5d5ac6e084897: done: 0.03145 sec","job_status":"done","queue_duration_s":0.816715,"scheduling_latency_s":0.81677,"redis_calls":10,"redis_duration_s":0.003273,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000741,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001875,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000657,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000552026,"duration_s":0.03145,"completed_at":"2026-10-06T14:49:04.137Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.147143] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"45e728fd813898b36e946e61","created_at":"2026-10-06T14:49:03.295Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.298Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-45e728fd813898b36e946e61: start","job_status":"start","queue_duration_s":0.879705,"scheduling_latency_s":0.879764} gitlab # [ 170.213191] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.244Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"45e728fd813898b36e946e61","created_at":"2026-10-06T14:49:03.295Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.298Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-45e728fd813898b36e946e61: done: 0.066282 sec","job_status":"done","queue_duration_s":0.879705,"scheduling_latency_s":0.879764,"redis_calls":19,"redis_duration_s":0.004238,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001071,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000294,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002214,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000379657,"duration_s":0.066282,"completed_at":"2026-10-06T14:49:04.244Z","load_balancing_strategy":"primary","db_duration_s":0.003544,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.262935] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.294Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d6b8bfe74050b2eccfb68d29","created_at":"2026-10-06T14:49:03.300Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"045ae53eb6ef0b7db2963d46c031c55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.303Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d6b8bfe74050b2eccfb68d29: start","job_status":"start","queue_duration_s":0.990382,"scheduling_latency_s":0.990436} gitlab # [ 170.326589] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d6b8bfe74050b2eccfb68d29","created_at":"2026-10-06T14:49:03.300Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"045ae53eb6ef0b7db2963d46c031c55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.303Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d6b8bfe74050b2eccfb68d29: done: 0.063658 sec","job_status":"done","queue_duration_s":0.990382,"scheduling_latency_s":0.990436,"redis_calls":12,"redis_duration_s":0.004998,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001604,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00102527,"exclusive_lock_hold_duration_s":0.019872079,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.063658,"completed_at":"2026-10-06T14:49:04.357Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.330731] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"95a24a927a56781cedb6bd85","created_at":"2026-10-06T14:49:03.311Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa899f8a7f3e923f869d9f8fbab7b94b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.315Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-95a24a927a56781cedb6bd85: start","job_status":"start","queue_duration_s":1.046605,"scheduling_latency_s":1.046639} gitlab # [ 170.385904] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"95a24a927a56781cedb6bd85","created_at":"2026-10-06T14:49:03.311Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa899f8a7f3e923f869d9f8fbab7b94b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.315Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-95a24a927a56781cedb6bd85: done: 0.034613 sec","job_status":"done","queue_duration_s":1.046605,"scheduling_latency_s":1.046639,"redis_calls":12,"redis_duration_s":0.003862,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000619,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001414,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000686679,"exclusive_lock_hold_duration_s":0.008536279999999999,"duration_s":0.034613,"completed_at":"2026-10-06T14:49:04.396Z","load_balancing_strategy":"primary","db_duration_s":0.004316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.392310] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1f394d1ccf1218ee6868ab15","created_at":"2026-10-06T14:49:03.323Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c99f1dce2bcbf9805322882d051edaa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.329Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1f394d1ccf1218ee6868ab15: start","job_status":"start","queue_duration_s":1.069181,"scheduling_latency_s":1.069207} gitlab # [ 170.437282] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.408Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 170.438237] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.412Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1f394d1ccf1218ee6868ab15","created_at":"2026-10-06T14:49:03.323Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c99f1dce2bcbf9805322882d051edaa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.329Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1f394d1ccf1218ee6868ab15: done: 0.014137 sec","job_status":"done","queue_duration_s":1.069181,"scheduling_latency_s":1.069207,"redis_calls":10,"redis_duration_s":0.002176,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000330768,"duration_s":0.014137,"completed_at":"2026-10-06T14:49:04.412Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.448833] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.414Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e533a276dbd7e3190cdf5893","created_at":"2026-10-06T14:49:03.337Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.344Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e533a276dbd7e3190cdf5893: start","job_status":"start","queue_duration_s":1.069431,"scheduling_latency_s":1.069446} gitlab # [ 170.499141] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e533a276dbd7e3190cdf5893","created_at":"2026-10-06T14:49:03.337Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.344Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e533a276dbd7e3190cdf5893: done: 0.083346 sec","job_status":"done","queue_duration_s":1.069431,"scheduling_latency_s":1.069446,"redis_calls":71,"redis_duration_s":0.027752,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003684,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000997,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.019209,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003862,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000278528,"duration_s":0.083346,"completed_at":"2026-10-06T14:49:04.497Z","load_balancing_strategy":"primary","db_duration_s":0.002492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.500619] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"17e3c240ef4077f7a9fd63d7","created_at":"2026-10-06T14:49:03.346Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dbffe826ce138c88ffe53dfb34784dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.352Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-17e3c240ef4077f7a9fd63d7: start","job_status":"start","queue_duration_s":1.14617,"scheduling_latency_s":1.146184} gitlab # [ 170.571610] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"17e3c240ef4077f7a9fd63d7","created_at":"2026-10-06T14:49:03.346Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dbffe826ce138c88ffe53dfb34784dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.352Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-17e3c240ef4077f7a9fd63d7: done: 0.104437 sec","job_status":"done","queue_duration_s":1.14617,"scheduling_latency_s":1.146184,"redis_calls":12,"redis_duration_s":0.0031609999999999997,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000532,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000436368,"exclusive_lock_hold_duration_s":0.08860734999999999,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.104437,"completed_at":"2026-10-06T14:49:04.603Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016118,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null} gitlab # [ 170.574633] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.606Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e9117d98214d622d7ef2c91d","created_at":"2026-10-06T14:49:03.355Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b54b9ed76a744ea46785e7b491511de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.361Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e9117d98214d622d7ef2c91d: start","job_status":"start","queue_duration_s":1.245126,"scheduling_latency_s":1.245152} gitlab # [ 170.622327] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.619Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 170.623213] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e9117d98214d622d7ef2c91d","created_at":"2026-10-06T14:49:03.355Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b54b9ed76a744ea46785e7b491511de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.361Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e9117d98214d622d7ef2c91d: done: 0.018223 sec","job_status":"done","queue_duration_s":1.245126,"scheduling_latency_s":1.245152,"redis_calls":10,"redis_duration_s":0.0037340000000000003,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000606,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000304508,"duration_s":0.018223,"completed_at":"2026-10-06T14:49:04.624Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.665543] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ae42debd81951f58d85ee843","created_at":"2026-10-06T14:49:03.423Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0989d64f1288447e6b8ba4b11c32603c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.444Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ae42debd81951f58d85ee843: start","job_status":"start","queue_duration_s":1.180933,"scheduling_latency_s":1.180947} gitlab # [ 170.666602] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ae42debd81951f58d85ee843","created_at":"2026-10-06T14:49:03.423Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0989d64f1288447e6b8ba4b11c32603c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.444Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ae42debd81951f58d85ee843: done: 0.035162 sec","job_status":"done","queue_duration_s":1.180933,"scheduling_latency_s":1.180947,"redis_calls":10,"redis_duration_s":0.004746,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00052,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000309257,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.035162,"completed_at":"2026-10-06T14:49:04.660Z","load_balancing_strategy":"primary","db_duration_s":0.017825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.719857] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"52f62c0c62fd8168bcd20972","created_at":"2026-10-06T14:49:03.461Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"319b0bfcfd2d9918dbf73dba7b23849a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.471Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-52f62c0c62fd8168bcd20972: start","job_status":"start","queue_duration_s":1.190465,"scheduling_latency_s":1.190479} gitlab # [ 170.878889] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"52f62c0c62fd8168bcd20972","created_at":"2026-10-06T14:49:03.461Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"319b0bfcfd2d9918dbf73dba7b23849a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.471Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-52f62c0c62fd8168bcd20972: done: 0.247975 sec","job_status":"done","queue_duration_s":1.190465,"scheduling_latency_s":1.190479,"redis_calls":565,"redis_duration_s":0.087972,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000442,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.086211,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.182953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341943,"duration_s":0.247975,"completed_at":"2026-10-06T14:49:04.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.937185] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"293346f3345e215d5e906833","created_at":"2026-10-06T14:49:03.478Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7a07dcbbf48f2c13e31a8596ef98c06","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.483Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-293346f3345e215d5e906833: start","job_status":"start","queue_duration_s":1.485058,"scheduling_latency_s":1.48509} gitlab # [ 170.969563] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"293346f3345e215d5e906833","created_at":"2026-10-06T14:49:03.478Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7a07dcbbf48f2c13e31a8596ef98c06","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.483Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-293346f3345e215d5e906833: done: 0.0327 sec","job_status":"done","queue_duration_s":1.485058,"scheduling_latency_s":1.48509,"redis_calls":10,"redis_duration_s":0.00151,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223492,"duration_s":0.0327,"completed_at":"2026-10-06T14:49:05.001Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.009230] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"14f971478dac8a47cbc9f218","created_at":"2026-10-06T14:49:03.489Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9271306ebbed3aee312fab41edefa6b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-06T14:49:03.495Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-14f971478dac8a47cbc9f218: start","job_status":"start","queue_duration_s":1.545457,"scheduling_latency_s":1.545483} gitlab # [ 171.034832] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.065Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 171.043706] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"14f971478dac8a47cbc9f218","created_at":"2026-10-06T14:49:03.489Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9271306ebbed3aee312fab41edefa6b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-06T14:49:03.495Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-14f971478dac8a47cbc9f218: done: 0.034115 sec","job_status":"done","queue_duration_s":1.545457,"scheduling_latency_s":1.545483,"redis_calls":10,"redis_duration_s":0.002813,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000532,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000771,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000460393,"duration_s":0.034115,"completed_at":"2026-10-06T14:49:05.074Z","load_balancing_strategy":"primary","db_duration_s":0.000847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.045503] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.076Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6af4767f1870dbac6895982a","created_at":"2026-10-06T14:49:03.506Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7154b0d76b289bb809fbcdf10a96039d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.514Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6af4767f1870dbac6895982a: start","job_status":"start","queue_duration_s":1.562368,"scheduling_latency_s":1.562394} gitlab # [ 171.055463] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.085Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 171.097401] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6af4767f1870dbac6895982a","created_at":"2026-10-06T14:49:03.506Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7154b0d76b289bb809fbcdf10a96039d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.514Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6af4767f1870dbac6895982a: done: 0.013394 sec","job_status":"done","queue_duration_s":1.562368,"scheduling_latency_s":1.562394,"redis_calls":10,"redis_duration_s":0.001341,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000804,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000244724,"duration_s":0.013394,"completed_at":"2026-10-06T14:49:05.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.098948] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.091Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7c63fe226415e690a613d2d5","created_at":"2026-10-06T14:49:03.531Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b166ccea757636346055aca8688d1d4","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.602Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7c63fe226415e690a613d2d5: start","job_status":"start","queue_duration_s":1.489036,"scheduling_latency_s":1.48905} gitlab # [ 171.142487] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7c63fe226415e690a613d2d5","created_at":"2026-10-06T14:49:03.531Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b166ccea757636346055aca8688d1d4","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.602Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7c63fe226415e690a613d2d5: done: 0.014299 sec","job_status":"done","queue_duration_s":1.489036,"scheduling_latency_s":1.48905,"redis_calls":12,"redis_duration_s":0.0017330000000000002,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000376863,"exclusive_lock_hold_duration_s":0.002842261,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.014299,"completed_at":"2026-10-06T14:49:05.105Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001892,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.152108] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.106Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"52fe32981f5d927c608ba329","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-52fe32981f5d927c608ba329: start","job_status":"start","queue_duration_s":0.867214,"scheduling_latency_s":0.867238} gitlab # [ 171.164802] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.116Z","message":"No existing merge request to be cleaned up."} gitlab # [ 171.166690] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.125Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"52fe32981f5d927c608ba329","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-52fe32981f5d927c608ba329: done: 0.019269 sec","job_status":"done","queue_duration_s":0.867214,"scheduling_latency_s":0.867238,"redis_calls":13,"redis_duration_s":0.001937,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000254781,"duration_s":0.019269,"completed_at":"2026-10-06T14:49:05.125Z","load_balancing_strategy":"primary","db_duration_s":0.00386,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.214766] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.126Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bcfbbcec2746022abc2caaa7","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bcfbbcec2746022abc2caaa7: start","job_status":"start","queue_duration_s":0.887461,"scheduling_latency_s":0.887475} gitlab # [ 171.215885] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.135Z","message":"No existing merge request to be cleaned up."} gitlab # [ 171.260134] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.140Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bcfbbcec2746022abc2caaa7","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bcfbbcec2746022abc2caaa7: done: 0.013516 sec","job_status":"done","queue_duration_s":0.887461,"scheduling_latency_s":0.887475,"redis_calls":10,"redis_duration_s":0.0013770000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000822,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013516,"completed_at":"2026-10-06T14:49:05.140Z","load_balancing_strategy":"primary","db_duration_s":0.004623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.261742] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.141Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7ca1139133ecc0f9ca1051fa","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7ca1139133ecc0f9ca1051fa: start","job_status":"start","queue_duration_s":0.901895,"scheduling_latency_s":0.901909} gitlab # [ 171.267846] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.147Z","message":"No existing merge request to be cleaned up."} gitlab # [ 171.269771] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.152Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7ca1139133ecc0f9ca1051fa","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7ca1139133ecc0f9ca1051fa: done: 0.011838 sec","job_status":"done","queue_duration_s":0.901895,"scheduling_latency_s":0.901909,"redis_calls":10,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000819,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011838,"completed_at":"2026-10-06T14:49:05.152Z","load_balancing_strategy":"primary","db_duration_s":0.001693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.313775] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.153Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b1604e69eb951d31c2c9b0c2","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b1604e69eb951d31c2c9b0c2: start","job_status":"start","queue_duration_s":0.914663,"scheduling_latency_s":0.914676} gitlab # [ 171.316638] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.160Z","message":"No existing merge request to be cleaned up."} gitlab # [ 171.319133] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.165Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b1604e69eb951d31c2c9b0c2","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b1604e69eb951d31c2c9b0c2: done: 0.011794 sec","job_status":"done","queue_duration_s":0.914663,"scheduling_latency_s":0.914676,"redis_calls":10,"redis_duration_s":0.001441,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011794,"completed_at":"2026-10-06T14:49:05.165Z","load_balancing_strategy":"primary","db_duration_s":0.001676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.374823] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6013b7788624eb766b8676d8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6013b7788624eb766b8676d8: start","job_status":"start","queue_duration_s":0.676214,"scheduling_latency_s":0.676227} gitlab # [ 171.376205] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6013b7788624eb766b8676d8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6013b7788624eb766b8676d8: done: 0.014074 sec","job_status":"done","queue_duration_s":0.676214,"scheduling_latency_s":0.676227,"redis_calls":16,"redis_duration_s":0.0023,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001396,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216787,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014074,"completed_at":"2026-10-06T14:49:05.180Z","load_balancing_strategy":"primary","db_duration_s":0.000504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.419507] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b51ff05ccc45f7b8ef632a9f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b51ff05ccc45f7b8ef632a9f: start","job_status":"start","queue_duration_s":0.691191,"scheduling_latency_s":0.691204} gitlab # [ 171.421196] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b51ff05ccc45f7b8ef632a9f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b51ff05ccc45f7b8ef632a9f: done: 0.009403 sec","job_status":"done","queue_duration_s":0.691191,"scheduling_latency_s":0.691204,"redis_calls":13,"redis_duration_s":0.001696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009403,"completed_at":"2026-10-06T14:49:05.190Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.462817] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4495d33eae0c7baa605c55b7","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4495d33eae0c7baa605c55b7: start","job_status":"start","queue_duration_s":0.70149,"scheduling_latency_s":0.701503} gitlab # [ 171.463796] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4495d33eae0c7baa605c55b7","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4495d33eae0c7baa605c55b7: done: 0.009401 sec","job_status":"done","queue_duration_s":0.70149,"scheduling_latency_s":0.701503,"redis_calls":13,"redis_duration_s":0.001637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009401,"completed_at":"2026-10-06T14:49:05.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.509705] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"333a7e25086d54037de8e1d6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-333a7e25086d54037de8e1d6: start","job_status":"start","queue_duration_s":0.711776,"scheduling_latency_s":0.711792} gitlab # [ 171.510491] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"333a7e25086d54037de8e1d6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-333a7e25086d54037de8e1d6: done: 0.009372 sec","job_status":"done","queue_duration_s":0.711776,"scheduling_latency_s":0.711792,"redis_calls":13,"redis_duration_s":0.001702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009372,"completed_at":"2026-10-06T14:49:05.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.565539] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b787648b7b026526287e2294","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b787648b7b026526287e2294: start","job_status":"start","queue_duration_s":0.722026,"scheduling_latency_s":0.722041} gitlab # [ 171.566301] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b787648b7b026526287e2294","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b787648b7b026526287e2294: done: 0.009356 sec","job_status":"done","queue_duration_s":0.722026,"scheduling_latency_s":0.722041,"redis_calls":13,"redis_duration_s":0.001634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009356,"completed_at":"2026-10-06T14:49:05.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.610188] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af1f6d21f68d471bd88bb9b6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af1f6d21f68d471bd88bb9b6: start","job_status":"start","queue_duration_s":0.732276,"scheduling_latency_s":0.73229} gitlab # [ 171.610973] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af1f6d21f68d471bd88bb9b6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af1f6d21f68d471bd88bb9b6: done: 0.009255 sec","job_status":"done","queue_duration_s":0.732276,"scheduling_latency_s":0.73229,"redis_calls":13,"redis_duration_s":0.001664,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009255,"completed_at":"2026-10-06T14:49:05.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.636752] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18644715ef2bfb8ccd02dd47","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18644715ef2bfb8ccd02dd47: start","job_status":"start","queue_duration_s":0.742513,"scheduling_latency_s":0.742527} gitlab # [ 171.686810] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18644715ef2bfb8ccd02dd47","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18644715ef2bfb8ccd02dd47: done: 0.009337 sec","job_status":"done","queue_duration_s":0.742513,"scheduling_latency_s":0.742527,"redis_calls":13,"redis_duration_s":0.0016510000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009337,"completed_at":"2026-10-06T14:49:05.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.688113] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8758b324baec3a999677d37","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8758b324baec3a999677d37: start","job_status":"start","queue_duration_s":0.752727,"scheduling_latency_s":0.752741} gitlab # [ 171.695483] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8758b324baec3a999677d37","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8758b324baec3a999677d37: done: 0.009383 sec","job_status":"done","queue_duration_s":0.752727,"scheduling_latency_s":0.752741,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009383,"completed_at":"2026-10-06T14:49:05.252Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.739261] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caa2b5d23cf694c72a0d15ca","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caa2b5d23cf694c72a0d15ca: start","job_status":"start","queue_duration_s":0.763011,"scheduling_latency_s":0.763024} gitlab # [ 171.779914] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caa2b5d23cf694c72a0d15ca","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caa2b5d23cf694c72a0d15ca: done: 0.009301 sec","job_status":"done","queue_duration_s":0.763011,"scheduling_latency_s":0.763024,"redis_calls":13,"redis_duration_s":0.001616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009301,"completed_at":"2026-10-06T14:49:05.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.781043] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8f4a376a74d6d851f8014d8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8f4a376a74d6d851f8014d8: start","job_status":"start","queue_duration_s":0.773202,"scheduling_latency_s":0.773217} gitlab # [ 171.830664] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8f4a376a74d6d851f8014d8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8f4a376a74d6d851f8014d8: done: 0.009569 sec","job_status":"done","queue_duration_s":0.773202,"scheduling_latency_s":0.773217,"redis_calls":13,"redis_duration_s":0.001886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001345,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009569,"completed_at":"2026-10-06T14:49:05.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.851826] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec6893798cb4a879122537ac","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec6893798cb4a879122537ac: start","job_status":"start","queue_duration_s":0.783618,"scheduling_latency_s":0.783631} gitlab # [ 171.852683] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec6893798cb4a879122537ac","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec6893798cb4a879122537ac: done: 0.009279 sec","job_status":"done","queue_duration_s":0.783618,"scheduling_latency_s":0.783631,"redis_calls":13,"redis_duration_s":0.0016250000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009279,"completed_at":"2026-10-06T14:49:05.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.873104] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"921648c2bf8fbbecbce14d23","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-921648c2bf8fbbecbce14d23: start","job_status":"start","queue_duration_s":0.793787,"scheduling_latency_s":0.793801} gitlab # [ 171.884866] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"921648c2bf8fbbecbce14d23","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-921648c2bf8fbbecbce14d23: done: 0.009317 sec","job_status":"done","queue_duration_s":0.793787,"scheduling_latency_s":0.793801,"redis_calls":13,"redis_duration_s":0.0016090000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009317,"completed_at":"2026-10-06T14:49:05.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.941097] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43939c182849d734dba8350c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43939c182849d734dba8350c: start","job_status":"start","queue_duration_s":0.804002,"scheduling_latency_s":0.804017} gitlab # [ 171.941913] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43939c182849d734dba8350c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43939c182849d734dba8350c: done: 0.009387 sec","job_status":"done","queue_duration_s":0.804002,"scheduling_latency_s":0.804017,"redis_calls":13,"redis_duration_s":0.001728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009387,"completed_at":"2026-10-06T14:49:05.303Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.981501] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8500a3d0ef906551806ffd0","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8500a3d0ef906551806ffd0: start","job_status":"start","queue_duration_s":0.814249,"scheduling_latency_s":0.814262} gitlab # [ 171.982247] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8500a3d0ef906551806ffd0","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8500a3d0ef906551806ffd0: done: 0.018942 sec","job_status":"done","queue_duration_s":0.814249,"scheduling_latency_s":0.814262,"redis_calls":13,"redis_duration_s":0.0026290000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018942,"completed_at":"2026-10-06T14:49:05.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.024748] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1089537b7880015b53f0e3db","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1089537b7880015b53f0e3db: start","job_status":"start","queue_duration_s":0.834924,"scheduling_latency_s":0.834957} gitlab # [ 172.025886] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1089537b7880015b53f0e3db","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1089537b7880015b53f0e3db: done: 0.011963 sec","job_status":"done","queue_duration_s":0.834924,"scheduling_latency_s":0.834957,"redis_calls":13,"redis_duration_s":0.001705,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011963,"completed_at":"2026-10-06T14:49:05.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.068179] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52a95941fff54bc612c0dd8c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52a95941fff54bc612c0dd8c: start","job_status":"start","queue_duration_s":0.847687,"scheduling_latency_s":0.847724} gitlab # [ 172.072227] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52a95941fff54bc612c0dd8c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52a95941fff54bc612c0dd8c: done: 0.012174 sec","job_status":"done","queue_duration_s":0.847687,"scheduling_latency_s":0.847724,"redis_calls":13,"redis_duration_s":0.004482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012174,"completed_at":"2026-10-06T14:49:05.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.117635] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acbf604b27d7d49eb03f8792","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acbf604b27d7d49eb03f8792: start","job_status":"start","queue_duration_s":0.864881,"scheduling_latency_s":0.864896} gitlab # [ 172.118507] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acbf604b27d7d49eb03f8792","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acbf604b27d7d49eb03f8792: done: 0.014557 sec","job_status":"done","queue_duration_s":0.864881,"scheduling_latency_s":0.864896,"redis_calls":13,"redis_duration_s":0.0057669999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004266,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014557,"completed_at":"2026-10-06T14:49:05.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.160126] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1802ca6b6b9e408c54ea6e4","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1802ca6b6b9e408c54ea6e4: start","job_status":"start","queue_duration_s":0.880666,"scheduling_latency_s":0.880681} gitlab # [ 172.163951] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1802ca6b6b9e408c54ea6e4","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1802ca6b6b9e408c54ea6e4: done: 0.009903 sec","job_status":"done","queue_duration_s":0.880666,"scheduling_latency_s":0.880681,"redis_calls":13,"redis_duration_s":0.002386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009903,"completed_at":"2026-10-06T14:49:05.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.209161] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9b93de655131fc0be49298e","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9b93de655131fc0be49298e: start","job_status":"start","queue_duration_s":0.891584,"scheduling_latency_s":0.891598} gitlab # [ 172.210585] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9b93de655131fc0be49298e","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9b93de655131fc0be49298e: done: 0.009717 sec","job_status":"done","queue_duration_s":0.891584,"scheduling_latency_s":0.891598,"redis_calls":13,"redis_duration_s":0.0022570000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001569,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009717,"completed_at":"2026-10-06T14:49:05.391Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.251542] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36073d04aef4674df001620d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36073d04aef4674df001620d: start","job_status":"start","queue_duration_s":0.902359,"scheduling_latency_s":0.902372} gitlab # [ 172.290288] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36073d04aef4674df001620d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36073d04aef4674df001620d: done: 0.009772 sec","job_status":"done","queue_duration_s":0.902359,"scheduling_latency_s":0.902372,"redis_calls":13,"redis_duration_s":0.002252,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001482,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009772,"completed_at":"2026-10-06T14:49:05.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.291406] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de142f8e24ae55138ebb7585","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de142f8e24ae55138ebb7585: start","job_status":"start","queue_duration_s":0.913149,"scheduling_latency_s":0.913162} gitlab # [ 172.302534] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de142f8e24ae55138ebb7585","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de142f8e24ae55138ebb7585: done: 0.012357 sec","job_status":"done","queue_duration_s":0.913149,"scheduling_latency_s":0.913162,"redis_calls":13,"redis_duration_s":0.004704,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003634,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012357,"completed_at":"2026-10-06T14:49:05.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.349648] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd91dab72ec5abeb8dbc3c6c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd91dab72ec5abeb8dbc3c6c: start","job_status":"start","queue_duration_s":0.92688,"scheduling_latency_s":0.926893} gitlab # [ 172.350668] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd91dab72ec5abeb8dbc3c6c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd91dab72ec5abeb8dbc3c6c: done: 0.009873 sec","job_status":"done","queue_duration_s":0.92688,"scheduling_latency_s":0.926893,"redis_calls":13,"redis_duration_s":0.002281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001542,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009873,"completed_at":"2026-10-06T14:49:05.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.390534] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8217425a022af0f2cf5c193e","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8217425a022af0f2cf5c193e: start","job_status":"start","queue_duration_s":0.937778,"scheduling_latency_s":0.937791} gitlab # [ 172.394601] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8217425a022af0f2cf5c193e","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8217425a022af0f2cf5c193e: done: 0.010036 sec","job_status":"done","queue_duration_s":0.937778,"scheduling_latency_s":0.937791,"redis_calls":13,"redis_duration_s":0.002476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010036,"completed_at":"2026-10-06T14:49:05.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.453649] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea93cb4d518599a60b41a371","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea93cb4d518599a60b41a371: start","job_status":"start","queue_duration_s":0.949196,"scheduling_latency_s":0.949209} gitlab # [ 172.454297] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea93cb4d518599a60b41a371","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea93cb4d518599a60b41a371: done: 0.010617 sec","job_status":"done","queue_duration_s":0.949196,"scheduling_latency_s":0.949209,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010617,"completed_at":"2026-10-06T14:49:05.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.477170] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5c83d5905f9f8d5c4d08f32","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5c83d5905f9f8d5c4d08f32: start","job_status":"start","queue_duration_s":0.96267,"scheduling_latency_s":0.962683} gitlab # [ 172.488726] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5c83d5905f9f8d5c4d08f32","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5c83d5905f9f8d5c4d08f32: done: 0.01099 sec","job_status":"done","queue_duration_s":0.96267,"scheduling_latency_s":0.962683,"redis_calls":13,"redis_duration_s":0.00278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01099,"completed_at":"2026-10-06T14:49:05.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.533727] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45bdcd21cdc215b345a3e03d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45bdcd21cdc215b345a3e03d: start","job_status":"start","queue_duration_s":0.974763,"scheduling_latency_s":0.974778} gitlab # [ 172.534747] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45bdcd21cdc215b345a3e03d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45bdcd21cdc215b345a3e03d: done: 0.011238 sec","job_status":"done","queue_duration_s":0.974763,"scheduling_latency_s":0.974778,"redis_calls":13,"redis_duration_s":0.0031739999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002323,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011238,"completed_at":"2026-10-06T14:49:05.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.583703] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c3d122e7dfaf60cbee33512","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c3d122e7dfaf60cbee33512: start","job_status":"start","queue_duration_s":0.987123,"scheduling_latency_s":0.987136} gitlab # [ 172.584430] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c3d122e7dfaf60cbee33512","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c3d122e7dfaf60cbee33512: done: 0.010872 sec","job_status":"done","queue_duration_s":0.987123,"scheduling_latency_s":0.987136,"redis_calls":13,"redis_duration_s":0.0026249999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010872,"completed_at":"2026-10-06T14:49:05.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.629080] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cc22807456a2fffdb05eb39","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cc22807456a2fffdb05eb39: start","job_status":"start","queue_duration_s":0.999107,"scheduling_latency_s":0.999121} gitlab # [ 172.629773] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cc22807456a2fffdb05eb39","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cc22807456a2fffdb05eb39: done: 0.0165 sec","job_status":"done","queue_duration_s":0.999107,"scheduling_latency_s":0.999121,"redis_calls":13,"redis_duration_s":0.007986,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00337,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0165,"completed_at":"2026-10-06T14:49:05.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.673779] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14c6841dc1fa1b3662b5bf4f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14c6841dc1fa1b3662b5bf4f: start","job_status":"start","queue_duration_s":1.016753,"scheduling_latency_s":1.016766} gitlab # [ 172.674535] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14c6841dc1fa1b3662b5bf4f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14c6841dc1fa1b3662b5bf4f: done: 0.086288 sec","job_status":"done","queue_duration_s":1.016753,"scheduling_latency_s":1.016766,"redis_calls":13,"redis_duration_s":0.075604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.074644,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.086288,"completed_at":"2026-10-06T14:49:05.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.709690] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5debd2fd2a7da38acd9f5d80","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5debd2fd2a7da38acd9f5d80: start","job_status":"start","queue_duration_s":1.104767,"scheduling_latency_s":1.104789} gitlab # [ 172.721128] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5debd2fd2a7da38acd9f5d80","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5debd2fd2a7da38acd9f5d80: done: 0.083381 sec","job_status":"done","queue_duration_s":1.104767,"scheduling_latency_s":1.104789,"redis_calls":13,"redis_duration_s":0.070855,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002273,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.068582,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.083381,"completed_at":"2026-10-06T14:49:05.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.764635] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e257fab35e4fde112a7bbe5c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e257fab35e4fde112a7bbe5c: start","job_status":"start","queue_duration_s":1.190128,"scheduling_latency_s":1.19015} gitlab # [ 172.767207] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e257fab35e4fde112a7bbe5c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e257fab35e4fde112a7bbe5c: done: 0.010786 sec","job_status":"done","queue_duration_s":1.190128,"scheduling_latency_s":1.19015,"redis_calls":13,"redis_duration_s":0.001929,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010786,"completed_at":"2026-10-06T14:49:05.691Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.809324] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"828f7ce19cc6bc50d16af6a5","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-828f7ce19cc6bc50d16af6a5: start","job_status":"start","queue_duration_s":1.201888,"scheduling_latency_s":1.201902} gitlab # [ 172.812916] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"828f7ce19cc6bc50d16af6a5","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-828f7ce19cc6bc50d16af6a5: done: 0.009486 sec","job_status":"done","queue_duration_s":1.201888,"scheduling_latency_s":1.201902,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009486,"completed_at":"2026-10-06T14:49:05.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.859616] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cbe0d9e1f6ae006874e50ab","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cbe0d9e1f6ae006874e50ab: start","job_status":"start","queue_duration_s":1.212376,"scheduling_latency_s":1.212389} gitlab # [ 172.860487] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cbe0d9e1f6ae006874e50ab","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cbe0d9e1f6ae006874e50ab: done: 0.009471 sec","job_status":"done","queue_duration_s":1.212376,"scheduling_latency_s":1.212389,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009471,"completed_at":"2026-10-06T14:49:05.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.913073] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ed0704d7d50f914ee247ecf","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ed0704d7d50f914ee247ecf: start","job_status":"start","queue_duration_s":1.222866,"scheduling_latency_s":1.222882} gitlab # [ 172.913709] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ed0704d7d50f914ee247ecf","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ed0704d7d50f914ee247ecf: done: 0.01937 sec","job_status":"done","queue_duration_s":1.222866,"scheduling_latency_s":1.222882,"redis_calls":13,"redis_duration_s":0.011112,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010257,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01937,"completed_at":"2026-10-06T14:49:05.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.956166] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e6220794733953173867473","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e6220794733953173867473: start","job_status":"start","queue_duration_s":1.243152,"scheduling_latency_s":1.243166} gitlab # [ 172.956887] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e6220794733953173867473","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e6220794733953173867473: done: 0.009764 sec","job_status":"done","queue_duration_s":1.243152,"scheduling_latency_s":1.243166,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009764,"completed_at":"2026-10-06T14:49:05.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.987924] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f058c2fb26ee2240f31221a","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f058c2fb26ee2240f31221a: start","job_status":"start","queue_duration_s":1.253756,"scheduling_latency_s":1.253769} gitlab # [ 172.999528] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f058c2fb26ee2240f31221a","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f058c2fb26ee2240f31221a: done: 0.009481 sec","job_status":"done","queue_duration_s":1.253756,"scheduling_latency_s":1.253769,"redis_calls":13,"redis_duration_s":0.0017490000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009481,"completed_at":"2026-10-06T14:49:05.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.039816] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ebdf83d825cd9b5b949fada","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ebdf83d825cd9b5b949fada: start","job_status":"start","queue_duration_s":1.26409,"scheduling_latency_s":1.264103} gitlab # [ 173.083201] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ebdf83d825cd9b5b949fada","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ebdf83d825cd9b5b949fada: done: 0.009572 sec","job_status":"done","queue_duration_s":1.26409,"scheduling_latency_s":1.264103,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009572,"completed_at":"2026-10-06T14:49:05.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.084251] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44a52d15429c32457417b48c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44a52d15429c32457417b48c: start","job_status":"start","queue_duration_s":1.274497,"scheduling_latency_s":1.274513} gitlab # [ 173.129721] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44a52d15429c32457417b48c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44a52d15429c32457417b48c: done: 0.011072 sec","job_status":"done","queue_duration_s":1.274497,"scheduling_latency_s":1.274513,"redis_calls":13,"redis_duration_s":0.002998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002479,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011072,"completed_at":"2026-10-06T14:49:05.775Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.130717] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea2c44f9186199c7c628ea9a","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea2c44f9186199c7c628ea9a: start","job_status":"start","queue_duration_s":1.286594,"scheduling_latency_s":1.286608} gitlab # [ 173.174758] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea2c44f9186199c7c628ea9a","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea2c44f9186199c7c628ea9a: done: 0.00991 sec","job_status":"done","queue_duration_s":1.286594,"scheduling_latency_s":1.286608,"redis_calls":13,"redis_duration_s":0.001573,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00991,"completed_at":"2026-10-06T14:49:05.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.175732] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19f01ff1bfc53cf755c72d7d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19f01ff1bfc53cf755c72d7d: start","job_status":"start","queue_duration_s":1.297373,"scheduling_latency_s":1.297388} gitlab # [ 173.219628] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19f01ff1bfc53cf755c72d7d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19f01ff1bfc53cf755c72d7d: done: 0.009469 sec","job_status":"done","queue_duration_s":1.297373,"scheduling_latency_s":1.297388,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009469,"completed_at":"2026-10-06T14:49:05.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.221095] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fd01f11f2fc7c07e66f95d1","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fd01f11f2fc7c07e66f95d1: start","job_status":"start","queue_duration_s":1.307842,"scheduling_latency_s":1.307856} gitlab # [ 173.232727] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fd01f11f2fc7c07e66f95d1","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fd01f11f2fc7c07e66f95d1: done: 0.009477 sec","job_status":"done","queue_duration_s":1.307842,"scheduling_latency_s":1.307856,"redis_calls":13,"redis_duration_s":0.0015710000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009477,"completed_at":"2026-10-06T14:49:05.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.287330] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"189aeacaf1a0e4d2538c4cb6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-189aeacaf1a0e4d2538c4cb6: start","job_status":"start","queue_duration_s":1.318349,"scheduling_latency_s":1.318364} gitlab # [ 173.288474] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"189aeacaf1a0e4d2538c4cb6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-189aeacaf1a0e4d2538c4cb6: done: 0.015659 sec","job_status":"done","queue_duration_s":1.318349,"scheduling_latency_s":1.318364,"redis_calls":13,"redis_duration_s":0.007254999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005729,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015659,"completed_at":"2026-10-06T14:49:05.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.336657] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9d9103699538b3ef6eeb5b8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9d9103699538b3ef6eeb5b8: start","job_status":"start","queue_duration_s":1.335059,"scheduling_latency_s":1.335073} gitlab # [ 173.337858] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9d9103699538b3ef6eeb5b8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9d9103699538b3ef6eeb5b8: done: 0.009561 sec","job_status":"done","queue_duration_s":1.335059,"scheduling_latency_s":1.335073,"redis_calls":13,"redis_duration_s":0.001645,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009561,"completed_at":"2026-10-06T14:49:05.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.378316] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c30f53f633ddd0209a2ad54b","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c30f53f633ddd0209a2ad54b: start","job_status":"start","queue_duration_s":1.345599,"scheduling_latency_s":1.345612} gitlab # [ 173.379272] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c30f53f633ddd0209a2ad54b","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c30f53f633ddd0209a2ad54b: done: 0.028789 sec","job_status":"done","queue_duration_s":1.345599,"scheduling_latency_s":1.345612,"redis_calls":13,"redis_duration_s":0.017877,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017242,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028789,"completed_at":"2026-10-06T14:49:05.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.432903] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3f5a31167482a0ebf9861e3","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3f5a31167482a0ebf9861e3: start","job_status":"start","queue_duration_s":1.375629,"scheduling_latency_s":1.375652} gitlab # [ 173.433795] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3f5a31167482a0ebf9861e3","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3f5a31167482a0ebf9861e3: done: 0.053834 sec","job_status":"done","queue_duration_s":1.375629,"scheduling_latency_s":1.375652,"redis_calls":13,"redis_duration_s":0.001924,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.053834,"completed_at":"2026-10-06T14:49:05.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.478506] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"295e2e3978404dcb524f3ab9","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-295e2e3978404dcb524f3ab9: start","job_status":"start","queue_duration_s":1.430489,"scheduling_latency_s":1.430508} gitlab # [ 173.479464] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"295e2e3978404dcb524f3ab9","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-295e2e3978404dcb524f3ab9: done: 0.010025 sec","job_status":"done","queue_duration_s":1.430489,"scheduling_latency_s":1.430508,"redis_calls":13,"redis_duration_s":0.001678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001139,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010025,"completed_at":"2026-10-06T14:49:05.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.536509] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c3f6809b10f3a21aea7b1f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c3f6809b10f3a21aea7b1f: start","job_status":"start","queue_duration_s":1.441376,"scheduling_latency_s":1.441391} gitlab # [ 173.537367] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c3f6809b10f3a21aea7b1f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c3f6809b10f3a21aea7b1f: done: 0.009588 sec","job_status":"done","queue_duration_s":1.441376,"scheduling_latency_s":1.441391,"redis_calls":13,"redis_duration_s":0.001629,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009588,"completed_at":"2026-10-06T14:49:05.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.577186] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8789ba027fbca1ce74eebbe","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8789ba027fbca1ce74eebbe: start","job_status":"start","queue_duration_s":1.451844,"scheduling_latency_s":1.451858} gitlab # [ 173.577907] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8789ba027fbca1ce74eebbe","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8789ba027fbca1ce74eebbe: done: 0.009513 sec","job_status":"done","queue_duration_s":1.451844,"scheduling_latency_s":1.451858,"redis_calls":13,"redis_duration_s":0.0019979999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001432,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009513,"completed_at":"2026-10-06T14:49:05.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.616833] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdab447fc144a4fa248a2428","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdab447fc144a4fa248a2428: start","job_status":"start","queue_duration_s":1.462228,"scheduling_latency_s":1.462241} gitlab # [ 173.617751] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdab447fc144a4fa248a2428","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdab447fc144a4fa248a2428: done: 0.009688 sec","job_status":"done","queue_duration_s":1.462228,"scheduling_latency_s":1.462241,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009688,"completed_at":"2026-10-06T14:49:05.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.662127] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ab7cd960b8e1df9b9050495","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ab7cd960b8e1df9b9050495: start","job_status":"start","queue_duration_s":1.475109,"scheduling_latency_s":1.475124} gitlab # [ 173.662856] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:06.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ab7cd960b8e1df9b9050495","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ab7cd960b8e1df9b9050495: done: 0.590922 sec","job_status":"done","queue_duration_s":1.475109,"scheduling_latency_s":1.475124,"redis_calls":13,"redis_duration_s":0.5777519999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.576364,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001388,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.590922,"completed_at":"2026-10-06T14:49:06.556Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.873427] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1456193418 wd_nsec: 1456193539 gitlab # [ 191.318184] postgres[2483]: [2483] ERROR: relation "table_without_models" does not exist gitlab # [ 191.318828] postgres[2483]: [2483] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 194.236722] runuser[2267]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 194.239570] setup-gitlab-start[2249]: + systemctl restart gitlab-sidekiq.service gitlab # [ 194.268727] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 194.270564] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:28.300Z","message":"Shutting down"} gitlab # [ 194.271637] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:28.302Z","message":"Scheduler exiting..."} gitlab # [ 194.276643] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:28.308Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 194.277707] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:28.308Z","message":"Scheduler exiting..."} gitlab # [ 194.778922] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:28.810Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 197.784164] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:31.814Z","message":"Bye!"} gitlab # [ 197.809438] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:31.841Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1645,"worker_id":"sidekiq_0","memwd_rss_bytes":966451200,"retry":0} gitlab # [ 199.019109] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 199.021598] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 199.023508] systemd[1]: gitlab-sidekiq.service: Consumed 1min 2.380s CPU time over 2min 1.286s wall clock time, 967.7M memory peak, 4.4M read from disk. gitlab # [ 199.028278] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 199.030978] setup-gitlab-start[2249]: + mkdir -p /var/lib/secrets gitlab # [ 199.034977] setup-gitlab-start[2249]: + echo nixbot-test-token-of-20-chars gitlab # [ 199.037100] setup-gitlab-start[2249]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 199.039228] setup-gitlab-start[2249]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars gitlab # [ 199.310234] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:33 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 242 gitlab # [ 200.084441] gitaly[891]: time="2026-10-06T14:49:34.115Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.114" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.106403] gitaly[891]: time="2026-10-06T14:49:34.137Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.114" grpc.time_ms=1.244 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.188447] gitaly[891]: time="2026-10-06T14:49:34.220Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.109" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.219" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.212135] gitaly[891]: time="2026-10-06T14:49:34.220Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.109" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.219" grpc.time_ms=0.443 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.239273] gitaly[891]: time="2026-10-06T14:49:34.271Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS diskcache=b9b54616-2459-461f-b86a-069e32c2a760 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-06T14:49:44.115" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.225" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.240294] gitaly[891]: time="2026-10-06T14:49:34.271Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1567 command.oublock=32 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-06T14:49:44.115" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.225" grpc.time_ms=45.54 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.250393] gitaly[891]: time="2026-10-06T14:49:34.282Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.171" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.281" pid=891 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 200.250887] gitaly[891]: time="2026-10-06T14:49:34.282Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.171" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.281" grpc.time_ms=0.777 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.260779] gitaly[891]: time="2026-10-06T14:49:34.292Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:44.176" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.286" grpc.time_ms=5.777 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.315286] gitaly[891]: time="2026-10-06T14:49:34.347Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.236" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.346" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.325495] gitaly[891]: time="2026-10-06T14:49:34.347Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.236" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.346" grpc.time_ms=0.494 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.372559] gitaly[891]: time="2026-10-06T14:49:34.404Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS diskcache=4d7447da-4c0e-44f4-8d42-200c61208ded grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-06T14:49:44.238" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.349" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.373528] gitaly[891]: time="2026-10-06T14:49:34.404Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1576 command.oublock=32 command.real_time_ms=27 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-06T14:49:44.238" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.349" grpc.time_ms=54.854 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.403771] gitaly[891]: time="2026-10-06T14:49:34.435Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.434" pid=891 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 200.404821] gitaly[891]: time="2026-10-06T14:49:34.435Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.434" grpc.time_ms=1.125 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.436916] gitaly[891]: time="2026-10-06T14:49:34.468Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:44.029" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.459" grpc.time_ms=8.933 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.485261] gitaly[891]: time="2026-10-06T14:49:34.517Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.086" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.516" grpc.time_ms=0.223 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.503557] gitaly[891]: time="2026-10-06T14:49:34.535Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-06T14:49:44.104" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.535" grpc.time_ms=0.255 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.952977] gitaly[891]: time="2026-10-06T14:49:34.984Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:44.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.978" grpc.time_ms=6.42 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.341248] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:35 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 2006 gitlab # [ 201.345842] setup-gitlab-start[2537]: {"id":1,"message":null,"error":null} gitlab # [ 202.268052] sidekiq-cluster[2525]: {"severity":"INFO","time":"2026-10-06T14:49:36.281Z","message":"Starting cluster with 1 processes"} gitlab # [ 206.471784] gitaly[891]: time="2026-10-06T14:49:40.503Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2596ZRNDHG7RQB5YBGNB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:50.063" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:40.494" grpc.time_ms=8.768 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 206.534992] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:40 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 174 gitlab # [ 206.539765] setup-gitlab-start[2249]: + mkdir -p /tmp/test-flake gitlab # [ 206.541433] setup-gitlab-start[2249]: + cd /tmp/test-flake gitlab # [ 206.543055] setup-gitlab-start[2249]: + git init -b master gitlab # [ 206.563881] setup-gitlab-start[2611]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 206.566737] setup-gitlab-start[2249]: + git config user.name test gitlab # [ 206.568761] setup-gitlab-start[2249]: + git config user.email test@example.com gitlab # [ 206.571185] setup-gitlab-start[2249]: + cat gitlab # [ 206.572647] setup-gitlab-start[2249]: + git add flake.nix gitlab # [ 206.574474] setup-gitlab-start[2249]: + git commit -m 'initial commit' gitlab # [ 206.592340] setup-gitlab-start[2616]: [master (root-commit) a19aff1] initial commit gitlab # [ 206.594804] setup-gitlab-start[2616]: 1 file changed, 10 insertions(+) gitlab # [ 206.596189] setup-gitlab-start[2616]: create mode 100644 flake.nix gitlab # [ 206.597338] setup-gitlab-start[2249]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 206.605175] setup-gitlab-start[2249]: + git push -u origin master gitlab # [ 206.666931] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 31 gitlab # [ 206.944253] gitaly[891]: time="2026-10-06T14:49:40.976Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V25JXE9MC24JSV2THDNDJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:40.964" grpc.time_ms=11.76 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 206.946049] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 274 gitlab # [ 207.209709] gitaly[891]: time="2026-10-06T14:49:41.241Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:51.121" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:41.231" grpc.time_ms=9.605 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.243233] gitaly[891]: time="2026-10-06T14:49:41.275Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-06T14:50:11.065" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-06T14:49:41.266" grpc.time_ms=8.354 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.259526] gitaly[891]: time="2026-10-06T14:49:41.291Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M48V25WSJYRJM7HDTYWFNKXD duration_ms=112ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 207.329214] gitaly[891]: time="2026-10-06T14:49:41.360Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M48V25WSJYRJM7HDTYWFNKXD duration_ms=68ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 207.336038] gitaly[891]: time="2026-10-06T14:49:41.362Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:41.178" grpc.time_ms=182.948 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.379928] gitaly[891]: time="2026-10-06T14:49:41.411Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:41.410" grpc.time_ms=0.94 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.429633] gitaly[891]: time="2026-10-06T14:49:41.461Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:41.460" grpc.time_ms=1.263 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.463893] gitaly[891]: time="2026-10-06T14:49:41.495Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:41.495" grpc.time_ms=0.313 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.546413] gitaly[891]: time="2026-10-06T14:49:41.577Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:51.139" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:41.570" grpc.time_ms=7.449 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.594404] gitaly[891]: time="2026-10-06T14:49:41.626Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1562 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-06T14:49:51.181" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:41.611" grpc.time_ms=14.291 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.624250] gitaly[891]: time="2026-10-06T14:49:41.655Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M48V25WSJYRJM7HDTYWFNKXD duration_ms=131ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 207.625086] gitaly[891]: time="2026-10-06T14:49:41.656Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:41.523" grpc.time_ms=132.771 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.646469] gitaly[891]: time="2026-10-06T14:49:41.678Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD diskcache=5d6783c4-0861-4b92-ac54-b6c87f658dcc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:41.100" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.647227] gitaly[891]: time="2026-10-06T14:49:41.678Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=215 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13711 command.oublock=32 command.real_time_ms=568 command.spawn_token_fork_ms=0 command.system_time_ms=142 command.user_time_ms=73 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:41.100" grpc.time_ms=577.626 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.668102] gitlab-workhorse[822]: time="2026-10-06T14:49:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 207.668756] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:41 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 681 gitlab # [ 207.672973] setup-gitlab-start[2620]: To http://gitlab/root/test-flake.git gitlab # [ 207.673721] setup-gitlab-start[2620]: * [new branch] master -> master gitlab # [ 207.678553] setup-gitlab-start[2620]: branch 'master' set up to track 'origin/master'. gitlab # [ 207.682485] systemd[1]: Finished setup-gitlab.service. gitlab # [ 207.685263] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 208.60 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 208.933428] nixbot[2698]: {"ts": "2026-10-06T14:49:42.964Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 208.959104] nixbot[2698]: {"ts": "2026-10-06T14:49:42.990Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 208.971318] nixbot[2698]: {"ts": "2026-10-06T14:49:43.003Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 208.974319] nixbot[2698]: {"ts": "2026-10-06T14:49:43.006Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 208.977102] nixbot[2698]: {"ts": "2026-10-06T14:49:43.008Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 208.981067] nixbot[2698]: {"ts": "2026-10-06T14:49:43.012Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 208.984255] nixbot[2698]: {"ts": "2026-10-06T14:49:43.015Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 208.985595] nixbot[2698]: {"ts": "2026-10-06T14:49:43.017Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 208.989788] nixbot[2698]: {"ts": "2026-10-06T14:49:43.021Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 208.991604] nixbot[2698]: {"ts": "2026-10-06T14:49:43.023Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 208.995197] nixbot[2698]: {"ts": "2026-10-06T14:49:43.027Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 208.999476] nixbot[2698]: {"ts": "2026-10-06T14:49:43.031Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 209.001815] nixbot[2698]: {"ts": "2026-10-06T14:49:43.033Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 209.003628] nixbot[2698]: {"ts": "2026-10-06T14:49:43.035Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 209.006496] nixbot[2698]: {"ts": "2026-10-06T14:49:43.038Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 209.008411] nixbot[2698]: {"ts": "2026-10-06T14:49:43.040Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 209.010267] nixbot[2698]: {"ts": "2026-10-06T14:49:43.042Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 209.012058] nixbot[2698]: {"ts": "2026-10-06T14:49:43.043Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 209.015879] nixbot[2698]: {"ts": "2026-10-06T14:49:43.047Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 209.017455] nixbot[2698]: {"ts": "2026-10-06T14:49:43.049Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 209.018970] nixbot[2698]: {"ts": "2026-10-06T14:49:43.050Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 209.022294] nixbot[2698]: {"ts": "2026-10-06T14:49:43.054Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 209.023917] nixbot[2698]: {"ts": "2026-10-06T14:49:43.055Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 209.025911] nixbot[2698]: {"ts": "2026-10-06T14:49:43.057Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 209.027470] nixbot[2698]: {"ts": "2026-10-06T14:49:43.059Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 209.029815] nixbot[2698]: {"ts": "2026-10-06T14:49:43.061Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"} gitlab # [ 209.031659] nixbot[2698]: {"ts": "2026-10-06T14:49:43.063Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"} gitlab # [ 209.033209] nixbot[2698]: {"ts": "2026-10-06T14:49:43.065Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"} gitlab # [ 209.034807] nixbot[2698]: {"ts": "2026-10-06T14:49:43.066Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"} gitlab # [ 209.043436] nixbot[2698]: {"ts": "2026-10-06T14:49:43.075Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"} gitlab # [ 209.048331] nixbot[2698]: {"ts": "2026-10-06T14:49:43.079Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"} gitlab # [ 209.051593] nixbot[2698]: {"ts": "2026-10-06T14:49:43.083Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"} gitlab # [ 209.056145] nixbot[2698]: {"ts": "2026-10-06T14:49:43.087Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"} gitlab # [ 209.061177] nixbot[2698]: {"ts": "2026-10-06T14:49:43.092Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"} gitlab # [ 209.066175] nixbot[2698]: {"ts": "2026-10-06T14:49:43.097Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"} gitlab # [ 209.070856] nixbot[2698]: {"ts": "2026-10-06T14:49:43.102Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"} gitlab # [ 209.073701] nixbot[2698]: {"ts": "2026-10-06T14:49:43.105Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"} gitlab # [ 209.081191] nixbot[2698]: {"ts": "2026-10-06T14:49:43.113Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"} gitlab # [ 209.394941] nixbot[2698]: INFO: Started server process [2698] gitlab # [ 209.397130] nixbot[2698]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 209.416165] nixbot[2698]: INFO: ::ffff:127.0.0.1:47742 - "GET /health HTTP/1.1" 200 OK gitlab # [ 209.422072] systemd[1]: Started nixbot CI service. gitlab # [ 209.425469] systemd[1]: Reached target Multi-User System. gitlab # [ 209.427733] systemd[1]: Startup finished in 1.249s (kernel) + 3.636s (initrd) + 3min 24.540s (userspace) = 3min 29.427s. gitlab # [ 209.609919] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:43 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 195 gitlab # [ 209.617916] nixbot[2698]: {"ts": "2026-10-06T14:49:43.643Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 209.644413] nixbot[2698]: {"ts": "2026-10-06T14:49:43.676Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 209.747830] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 85 gitlab # [ 209.752539] nixbot[2698]: {"ts": "2026-10-06T14:49:43.784Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 209.758576] nixbot[2698]: {"ts": "2026-10-06T14:49:43.790Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 209.882299] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 118 gitlab # [ 209.884430] nixbot[2698]: {"ts": "2026-10-06T14:49:43.914Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab: (finished: waiting for unit nixbot.service, in 2.18 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 210.110937] nixbot[2698]: INFO: ::ffff:127.0.0.1:47754 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 210.181069] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 49 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds) (finished: subtest: project discovered and webhook registered, in 0.07 seconds) subtest: push delivers the webhook gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails' gitlab # [ 210.546149] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 644 gitlab # [ 210.548261] nixbot[2698]: {"ts": "2026-10-06T14:49:44.576Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 210.627341] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 67 gitlab # [ 210.632342] nixbot[2698]: {"ts": "2026-10-06T14:49:44.662Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 210.716453] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 77 gitlab # [ 210.722335] nixbot[2698]: {"ts": "2026-10-06T14:49:44.749Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 210.791391] gitaly[891]: time="2026-10-06T14:49:44.822Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V29HHM3WQAHX7T5QH669K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-06T14:50:14.610" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:44.811" grpc.time_ms=10.849 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 210.824735] gitaly[891]: time="2026-10-06T14:49:44.831Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V29HHM3WQAHX7T5QH669K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:14.630" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:44.831" grpc.time_ms=0.605 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 210.849161] gitaly[891]: time="2026-10-06T14:49:44.838Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V29HHM3WQAHX7T5QH669K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-06T14:49:54.003" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:44.833" grpc.time_ms=4.718 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 210.863591] nixbot[2698]: {"ts": "2026-10-06T14:49:44.858Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 210.865991] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 103 gitlab # [ 210.900289] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 71 gitlab # [ 210.904815] nixbot[2698]: {"ts": "2026-10-06T14:49:44.933Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 210.909989] nixbot[2698]: {"ts": "2026-10-06T14:49:44.941Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 211.059501] gitaly[891]: time="2026-10-06T14:49:45.091Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V29T83ZXM0NJRNH3JMZB4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.079" grpc.time_ms=11.66 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.088307] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 58 gitlab # [ 211.199265] gitaly[891]: time="2026-10-06T14:49:45.231Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V29X6476ZYBAVWTTR3SFB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.217" pid=891 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 211.221887] gitaly[891]: time="2026-10-06T14:49:45.231Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V29X6476ZYBAVWTTR3SFB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.217" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.246970] gitlab-workhorse[822]: time="2026-10-06T14:49:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 211.249641] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 105 gitlab # [ 211.251539] gitaly[891]: time="2026-10-06T14:49:45.231Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V29X6476ZYBAVWTTR3SFB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.217" grpc.time_ms=13.778 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.284775] gitaly[891]: time="2026-10-06T14:49:45.316Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A0MZA9332W111EKSVKZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.305" pid=891 remote_ip="2001:db8:1::1" request_sha=8799cec4b193202d14bee18ece0c1e1190292075 response_bytes=224 span.kind=server system=grpc gitlab # [ 211.295626] gitaly[891]: time="2026-10-06T14:49:45.316Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A0MZA9332W111EKSVKZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.305" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.309123] gitlab-workhorse[822]: time="2026-10-06T14:49:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=224 gitlab # [ 211.309673] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 80 gitlab # [ 211.310231] gitaly[891]: time="2026-10-06T14:49:45.316Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A0MZA9332W111EKSVKZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.305" grpc.time_ms=11.141 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.385399] gitaly[891]: time="2026-10-06T14:49:45.417Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V2A4WBB3D43NF48CHJSRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.406" grpc.time_ms=10.871 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.386834] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 45 gitlab # [ 211.486650] gitaly[891]: time="2026-10-06T14:49:45.518Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A6VWXVFZCR92TRNRPJ6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.506" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 211.488305] gitaly[891]: time="2026-10-06T14:49:45.518Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A6VWXVFZCR92TRNRPJ6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.506" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.490860] gitaly[891]: time="2026-10-06T14:49:45.521Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A6VWXVFZCR92TRNRPJ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.506" grpc.time_ms=14.787 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.492060] gitlab-workhorse[822]: time="2026-10-06T14:49:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 211.493124] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 86 gitlab # [ 211.641909] gitaly[891]: time="2026-10-06T14:49:45.673Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V2AC5DTNGTN76DDTF45HP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.660" grpc.time_ms=13.345 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.645294] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 70 gitlab # [ 211.766764] gitaly[891]: time="2026-10-06T14:49:45.797Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2AFA3CKXP8QG214MJBSC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.769" pid=891 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 211.768528] gitaly[891]: time="2026-10-06T14:49:45.798Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=7 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2AFA3CKXP8QG214MJBSC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.769" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.770584] gitlab-workhorse[822]: time="2026-10-06T14:49:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 211.772255] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 92 gitlab # [ 211.773432] gitaly[891]: time="2026-10-06T14:49:45.798Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=7 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2AFA3CKXP8QG214MJBSC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.769" grpc.time_ms=28.652 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 211.945286] gitaly[891]: time="2026-10-06T14:49:45.975Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:15.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:45.973" grpc.time_ms=0.986 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.019691] gitaly[891]: time="2026-10-06T14:49:46.051Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-06T14:50:16.038" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:46.039" grpc.time_ms=11.995 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.085412] gitaly[891]: time="2026-10-06T14:49:46.117Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:49:56.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:46.103" grpc.time_ms=13.672 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.137712] gitaly[891]: time="2026-10-06T14:49:46.169Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:49:56.056" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:46.156" grpc.time_ms=12.56 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.223684] gitaly[891]: time="2026-10-06T14:49:46.255Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-06T14:49:56.153" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:46.254" grpc.time_ms=0.56 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.241294] gitaly[891]: time="2026-10-06T14:49:46.273Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-06T14:49:56.164" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:46.265" grpc.time_ms=7.584 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.314365] gitaly[891]: time="2026-10-06T14:49:46.346Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:46.345" grpc.time_ms=0.579 pid=891 span.kind=server system=grpc gitlab # [ 212.348542] gitaly[891]: time="2026-10-06T14:49:46.380Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:46.379" grpc.time_ms=1.084 pid=891 span.kind=server system=grpc gitlab # [ 212.368562] gitaly[891]: time="2026-10-06T14:49:46.400Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV diskcache=1089e014-e222-42b3-a181-c8466d02fd43 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:49:56.206" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:46.307" pid=891 ref=refs/keep-around/a19aff1adb0d9b72e397bc88315b31884feb66bc remote_ip="2001:db8:1::1" revision=a19aff1adb0d9b72e397bc88315b31884feb66bc span.kind=server system=grpc username=root gitlab # [ 212.369200] gitaly[891]: time="2026-10-06T14:49:46.400Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=66 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5522 command.oublock=8 command.real_time_ms=82 command.spawn_token_fork_ms=3 command.system_time_ms=48 command.user_time_ms=18 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:49:56.206" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:46.307" grpc.time_ms=93.491 pid=891 ref=refs/keep-around/a19aff1adb0d9b72e397bc88315b31884feb66bc remote_ip="2001:db8:1::1" revision=a19aff1adb0d9b72e397bc88315b31884feb66bc span.kind=server system=grpc username=root gitlab # [ 212.372882] gitaly[891]: time="2026-10-06T14:49:46.404Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:16.403" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:46.404" grpc.time_ms=0.39 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.495538] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 624 gitlab # [ 212.497896] nixbot[2698]: {"ts": "2026-10-06T14:49:46.527Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""} gitlab # [ 212.507448] nixbot[2698]: {"ts": "2026-10-06T14:49:46.538Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a19aff1adb0d-0"} gitlab # [ 212.689808] nixbot[2698]: {"ts": "2026-10-06T14:49:46.721Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a19aff1adb0d-0", "argv0": "bwrap"} gitlab # [ 212.797098] systemd[1]: Started Nix Daemon. gitlab # [ 212.861058] nix-daemon[2873]: accepted connection from pid 2868, user nixbot gitlab # [ 217.090730] nix-daemon[2873]: accepted connection from pid 2915, user nixbot gitlab # [ 217.112502] nix-daemon[2873]: accepted connection from pid 2868, user nixbot gitlab # [ 221.578986] nix-daemon[2873]: accepted connection from pid 2868, user nixbot gitlab # [ 221.671126] nix-daemon[2873]: accepted connection from pid 2964, user nixbot gitlab # [ 221.714206] gitaly[891]: time="2026-10-06T14:49:55.745Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2M7HKBGVWS2YBZSNEXGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:25.543" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:55.744" grpc.time_ms=0.746 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 221.893870] gitaly[891]: time="2026-10-06T14:49:55.925Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V2M7HKBGVWS2YBZSNEXGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:05.083" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:55.913" grpc.time_ms=11.916 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 221.985700] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 318 gitlab # [ 221.987896] nixbot[2698]: {"ts": "2026-10-06T14:49:56.017Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""} gitlab # [ 222.056651] gitaly[891]: time="2026-10-06T14:49:56.088Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2MHNPGA8QP4J6M8N6KNA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:26.086" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:56.087" grpc.time_ms=0.913 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 222.124470] gitaly[891]: time="2026-10-06T14:49:56.156Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V2MHNPGA8QP4J6M8N6KNA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:06.044" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:56.144" grpc.time_ms=11.289 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 222.197341] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 206 gitlab # [ 222.203281] nixbot[2698]: {"ts": "2026-10-06T14:49:56.230Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""} gitlab # [ 226.403043] nix-daemon[2873]: accepted connection from pid 3025, user nixbot gitlab # [ 226.471098] gitaly[891]: time="2026-10-06T14:50:00.501Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2RW6S4207MNZA3VES4HC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:30.294" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:00.495" grpc.time_ms=6.092 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 226.497270] gitaly[891]: time="2026-10-06T14:50:00.529Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V2RW6S4207MNZA3VES4HC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:10.092" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:00.523" grpc.time_ms=5.703 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 226.535169] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 111 gitlab # [ 226.538770] nixbot[2698]: {"ts": "2026-10-06T14:50:00.567Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""} gitlab # [ 226.800488] gitaly[891]: time="2026-10-06T14:50:00.832Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V2S6F6CVR5WZJYAR0007G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:00.822" grpc.time_ms=9.565 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 226.819649] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:00 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 67 gitlab # [ 226.887933] gitaly[891]: time="2026-10-06T14:50:00.919Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2S8M0EW6HF20AQDCE8M6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:00.912" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 226.889445] gitaly[891]: time="2026-10-06T14:50:00.920Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2S8M0EW6HF20AQDCE8M6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:00.912" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 226.890933] gitaly[891]: time="2026-10-06T14:50:00.921Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2S8M0EW6HF20AQDCE8M6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:00.912" grpc.time_ms=7.992 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 226.892417] gitlab-workhorse[822]: time="2026-10-06T14:50:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 226.894138] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 68 gitlab # [ 227.003071] gitaly[891]: time="2026-10-06T14:50:01.034Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V2SCTKZJWNBFZVR556N94 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:01.028" grpc.time_ms=6.147 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 227.016375] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 61 gitlab # [ 227.065535] gitaly[891]: time="2026-10-06T14:50:01.097Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2SETXAD6VNFPNWV5044N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:01.086" pid=891 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 227.067261] gitaly[891]: time="2026-10-06T14:50:01.097Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2SETXAD6VNFPNWV5044N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:01.086" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 227.095080] gitaly[891]: time="2026-10-06T14:50:01.126Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2SETXAD6VNFPNWV5044N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:01.086" grpc.time_ms=10.936 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 227.108486] gitlab-workhorse[822]: time="2026-10-06T14:50:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 227.110462] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 76 gitlab # [ 228.526373] sidekiq-cluster[2584]: 2026-10-06T14:50:02.557Z pid=2584 tid=xbk INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2584, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431861760} gitlab # [ 228.708235] sidekiq-cluster[2584]: W, [2026-10-06T14:50:02.739684 #2584] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 228.746460] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:02.778Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 230.559913] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:04.590Z","message":"GitLab reliable fetch activated!"} gitlab # [ 230.562401] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:04.591Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 251.316416] postgres[3275]: [3275] ERROR: relation "table_without_models" does not exist gitlab # [ 251.318500] postgres[3275]: [3275] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 253.749591] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:27.780Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 253.752411] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:27.784Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 253.753843] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:27.784Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 253.755361] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:27.784Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 253.756576] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:27.785Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 43.69 seconds) gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 253.972462] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:28 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 43 gitlab # [ 254.055444] gitaly[891]: time="2026-10-06T14:50:28.085Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KS9GBGF5FH7F3RF9W71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:28.072" grpc.time_ms=12.938 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 254.056852] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:28 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 76 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 254.390465] gitaly[891]: time="2026-10-06T14:50:28.422Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-06T14:50:58.210" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-06T14:50:28.410" grpc.time_ms=11.089 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.434262] gitaly[891]: time="2026-10-06T14:50:28.466Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 duration_ms=117ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 254.476318] gitaly[891]: time="2026-10-06T14:50:28.508Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 duration_ms=41ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 254.483421] gitaly[891]: time="2026-10-06T14:50:28.508Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:28.348" grpc.time_ms=160.319 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 254.542307] gitaly[891]: time="2026-10-06T14:50:28.573Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:28.573" grpc.time_ms=0.77 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 254.609787] gitaly[891]: time="2026-10-06T14:50:28.639Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:28.639" grpc.time_ms=0.605 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 254.663887] gitaly[891]: time="2026-10-06T14:50:28.695Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:28.695" grpc.time_ms=0.465 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 254.737629] gitaly[891]: time="2026-10-06T14:50:28.769Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 duration_ms=38ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 254.738881] gitaly[891]: time="2026-10-06T14:50:28.770Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:28.730" grpc.time_ms=39.97 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 254.779294] gitaly[891]: time="2026-10-06T14:50:28.811Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 diskcache=115893cf-ba5c-47dc-8a40-26d60c171670 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:28.267" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 254.796899] gitaly[891]: time="2026-10-06T14:50:28.828Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=247 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13533 command.oublock=32 command.real_time_ms=530 command.spawn_token_fork_ms=0 command.system_time_ms=156 command.user_time_ms=91 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:28.267" grpc.time_ms=543.34 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # [ 254.798369] gitlab-workhorse[822]: time="2026-10-06T14:50:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # a19aff1..1ff6467 [ 254.800483] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:28 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 703 gitlab # master -> master gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.95 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348' gitlab # [ 254.906604] nixbot[2698]: INFO: ::ffff:127.0.0.1:35062 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.08 seconds) gitlab # [ 255.246810] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.277Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"93c9656d1e19078cdab6f5dd","created_at":"2026-10-06T14:49:34.302Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.328Z","job_size_bytes":2,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-93c9656d1e19078cdab6f5dd: start","job_status":"start","queue_duration_s":54.949327,"scheduling_latency_s":54.94937} gitlab # [ 255.507123] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.538Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"93c9656d1e19078cdab6f5dd","created_at":"2026-10-06T14:49:34.302Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.328Z","job_size_bytes":2,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-93c9656d1e19078cdab6f5dd: done: 0.260651 sec","job_status":"done","queue_duration_s":54.949327,"scheduling_latency_s":54.94937,"redis_calls":25,"redis_duration_s":0.008996,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004964,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002349,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001683,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.119093907,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.260651,"completed_at":"2026-10-06T14:50:29.538Z","load_balancing_strategy":"primary","db_duration_s":0.065695,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.555760] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.587Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"5f7e4b854831f146eb6acb16","created_at":"2026-10-06T14:49:34.338Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.342Z","job_size_bytes":2,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-5f7e4b854831f146eb6acb16: start","job_status":"start","queue_duration_s":55.244671,"scheduling_latency_s":55.24471} gitlab # [ 255.694195] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.725Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"5f7e4b854831f146eb6acb16","created_at":"2026-10-06T14:49:34.338Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.342Z","job_size_bytes":2,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-5f7e4b854831f146eb6acb16: done: 0.138569 sec","job_status":"done","queue_duration_s":55.244671,"scheduling_latency_s":55.24471,"redis_calls":14,"redis_duration_s":0.003833,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000692,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001838,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.095759936,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.138569,"completed_at":"2026-10-06T14:50:29.725Z","load_balancing_strategy":"primary","db_duration_s":0.028016,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.773692] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.804Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1d8740fe8b03a51e660d39c1","created_at":"2026-10-06T14:49:34.851Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.857Z","job_size_bytes":5,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1d8740fe8b03a51e660d39c1: start","job_status":"start","queue_duration_s":54.947382,"scheduling_latency_s":54.947431} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348' gitlab # [ 255.947627] nixbot[2698]: INFO: ::ffff:127.0.0.1:35074 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.04 seconds) gitlab # [ 255.964520] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.995Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1d8740fe8b03a51e660d39c1","created_at":"2026-10-06T14:49:34.851Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.857Z","job_size_bytes":5,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1d8740fe8b03a51e660d39c1: done: 0.191164 sec","job_status":"done","queue_duration_s":54.947382,"scheduling_latency_s":54.947431,"redis_calls":12,"redis_duration_s":0.0036769999999999997,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000722,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002374,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.13544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052772,"duration_s":0.191164,"completed_at":"2026-10-06T14:50:29.995Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028787,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 256.033755] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.065Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"5eac0356ed56d367d969cdd0","created_at":"2026-10-06T14:49:34.898Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.905Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-5eac0356ed56d367d969cdd0: start","job_status":"start","queue_duration_s":55.159519,"scheduling_latency_s":55.159563} gitlab # [ 256.263832] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.294Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"5eac0356ed56d367d969cdd0","created_at":"2026-10-06T14:49:34.898Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.905Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-5eac0356ed56d367d969cdd0: done: 0.229552 sec","job_status":"done","queue_duration_s":55.159519,"scheduling_latency_s":55.159563,"redis_calls":11,"redis_duration_s":0.003077,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000853,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001678,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.188,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.188,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.144464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000332724,"duration_s":0.229552,"completed_at":"2026-10-06T14:50:30.294Z","load_balancing_strategy":"primary","db_duration_s":0.084268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.266761] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.295Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"72a2ae54513721aa2046d044","created_at":"2026-10-06T14:49:34.910Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.917Z","job_size_bytes":89,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-72a2ae54513721aa2046d044: start","job_status":"start","queue_duration_s":55.378752,"scheduling_latency_s":55.378766} gitlab # [ 256.412162] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.443Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"72a2ae54513721aa2046d044","created_at":"2026-10-06T14:49:34.910Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.917Z","job_size_bytes":89,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-72a2ae54513721aa2046d044: done: 0.14742 sec","job_status":"done","queue_duration_s":55.378752,"scheduling_latency_s":55.378766,"redis_calls":11,"redis_duration_s":0.003115,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000731,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000539,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051934,"duration_s":0.14742,"completed_at":"2026-10-06T14:50:30.443Z","load_balancing_strategy":"primary","db_duration_s":0.007793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.475723] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.506Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a19aff1adb0d9b72e397bc88315b31884feb66bc refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a97ff664faa41b660d336c99","created_at":"2026-10-06T14:49:41.551Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-cb0f6728aab441ce","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:41.556Z","job_size_bytes":185,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a97ff664faa41b660d336c99: start","job_status":"start","queue_duration_s":48.950335,"scheduling_latency_s":48.95037} gitlab # [ 256.501066] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.532Z","message":"changes: \"0000000000000000000000000000000000000000 a19aff1adb0d9b72e397bc88315b31884feb66bc refs/heads/master\\n\""} gitlab # [ 256.552797] gitaly[891]: time="2026-10-06T14:50:30.583Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:40.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:30.572" grpc.time_ms=11.397 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.585844] gitaly[891]: time="2026-10-06T14:50:30.617Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:50:40.038" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:30.608" grpc.time_ms=8.566 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.658712] gitaly[891]: time="2026-10-06T14:50:30.690Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-06T14:50:40.107" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:30.677" grpc.time_ms=12.518 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.714512] gitaly[891]: time="2026-10-06T14:50:30.746Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:30.745" grpc.time_ms=0.657 pid=891 span.kind=server system=grpc gitlab # [ 256.773816] gitaly[891]: time="2026-10-06T14:50:30.805Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:30.804" grpc.time_ms=0.582 pid=891 span.kind=server system=grpc gitlab # [ 256.806307] gitaly[891]: time="2026-10-06T14:50:30.838Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD diskcache=8a0b7bd1-a195-48dd-903f-6c2c1384f6b3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:50:40.136" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:30.706" pid=891 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 256.816507] gitaly[891]: time="2026-10-06T14:50:30.848Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=129 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5138 command.oublock=8 command.real_time_ms=119 command.spawn_token_fork_ms=0 command.system_time_ms=92 command.user_time_ms=37 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:50:40.136" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:30.706" grpc.time_ms=131.445 pid=891 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 256.828617] gitaly[891]: time="2026-10-06T14:50:30.860Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:50:40.289" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:30.859" grpc.time_ms=0.316 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.852756] gitaly[891]: time="2026-10-06T14:50:30.884Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=942 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-06T14:50:40.007" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:30.867" grpc.time_ms=16.656 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348' gitlab # [ 256.953751] gitaly[891]: time="2026-10-06T14:50:30.985Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=338 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-06T14:51:00.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:30.976" grpc.time_ms=8.384 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.04 seconds) gitlab # [ 256.986853] gitaly[891]: time="2026-10-06T14:50:31.010Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-06T14:50:41.009" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:31.009" grpc.time_ms=0.339 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.004780] gitaly[891]: time="2026-10-06T14:50:31.025Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-06T14:50:41.011" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-06T14:50:31.011" grpc.time_ms=14.142 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.017422] nixbot[2698]: INFO: ::ffff:127.0.0.1:35088 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK gitlab # [ 257.019455] gitaly[891]: time="2026-10-06T14:50:31.043Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:41.034" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:31.034" grpc.time_ms=8.099 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.031307] gitaly[891]: time="2026-10-06T14:50:31.058Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:41.050" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:31.050" grpc.time_ms=7.102 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.049575] gitaly[891]: time="2026-10-06T14:50:31.081Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-06T14:51:01.069" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:31.069" grpc.time_ms=11.579 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.440070] gitaly[891]: time="2026-10-06T14:50:31.471Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-06T14:50:41.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:31.470" grpc.time_ms=1.413 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.495476] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.525Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a19aff1adb0d9b72e397bc88315b31884feb66bc refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a97ff664faa41b660d336c99","created_at":"2026-10-06T14:49:41.551Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-cb0f6728aab441ce","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:41.556Z","job_size_bytes":185,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a97ff664faa41b660d336c99: done: 1.018862 sec","job_status":"done","queue_duration_s":48.950335,"scheduling_latency_s":48.95037,"gitaly_calls":13,"gitaly_duration_s":0.306354,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.061478000000000005,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.004217,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006903,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001928,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004859,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.021138,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.022433,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.19,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.213,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.574184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000875809,"exclusive_lock_hold_duration_s":0.038322747,"duration_s":1.018862,"completed_at":"2026-10-06T14:50:31.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.104533,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.543509] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.574Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ab1f2197ba1b759906825268","created_at":"2026-10-06T14:49:46.413Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.422Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ab1f2197ba1b759906825268: start","job_status":"start","queue_duration_s":45.152591,"scheduling_latency_s":45.152636} gitlab # [ 257.724222] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.755Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ab1f2197ba1b759906825268","created_at":"2026-10-06T14:49:46.413Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.422Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ab1f2197ba1b759906825268: done: 0.180547 sec","job_status":"done","queue_duration_s":45.152591,"scheduling_latency_s":45.152636,"redis_calls":16,"redis_duration_s":0.005030000000000001,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002818,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000573,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000536102,"duration_s":0.180547,"completed_at":"2026-10-06T14:50:31.755Z","load_balancing_strategy":"primary","db_duration_s":0.024333,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.804559] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.835Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"1cda2610e49d82994e197fc1","created_at":"2026-10-06T14:49:46.422Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.427Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-1cda2610e49d82994e197fc1: start","job_status":"start","queue_duration_s":45.407978,"scheduling_latency_s":45.408028} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348' gitlab # [ 257.935630] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.967Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"1cda2610e49d82994e197fc1","created_at":"2026-10-06T14:49:46.422Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.427Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-1cda2610e49d82994e197fc1: done: 0.131593 sec","job_status":"done","queue_duration_s":45.407978,"scheduling_latency_s":45.408028,"redis_calls":21,"redis_duration_s":0.005916,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003024,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001489,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000319873,"duration_s":0.131593,"completed_at":"2026-10-06T14:50:31.967Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034596,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.939782] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.968Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b065b3efcc43c86e238162f7","created_at":"2026-10-06T14:49:46.509Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.513Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b065b3efcc43c86e238162f7: start","job_status":"start","queue_duration_s":45.454729,"scheduling_latency_s":45.454744} gitlab # [ 258.033655] nixbot[2698]: INFO: ::ffff:127.0.0.1:35096 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.04 seconds) gitlab # [ 258.200866] gitaly[891]: time="2026-10-06T14:50:32.231Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:32.231" grpc.time_ms=0.337 pid=891 span.kind=server system=grpc gitlab # [ 258.254848] gitaly[891]: time="2026-10-06T14:50:32.286Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:32.286" grpc.time_ms=0.296 pid=891 span.kind=server system=grpc gitlab # [ 258.316376] gitaly[891]: time="2026-10-06T14:50:32.348Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:32.347" grpc.time_ms=0.464 pid=891 span.kind=server system=grpc gitlab # [ 258.350961] gitaly[891]: time="2026-10-06T14:50:32.382Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV diskcache=061e4d68-20b3-41c2-b676-68fd99ef85ac grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:02.190" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:32.190" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.351858] gitaly[891]: time="2026-10-06T14:50:32.383Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=179 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7311 command.oublock=0 command.real_time_ms=181 command.spawn_token_fork_ms=0 command.system_time_ms=122 command.user_time_ms=57 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:02.190" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:32.190" grpc.time_ms=192.146 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.502146] gitaly[891]: time="2026-10-06T14:50:32.533Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:02.531" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:32.532" grpc.time_ms=1.354 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.579734] gitaly[891]: time="2026-10-06T14:50:32.611Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:02.608" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:32.609" grpc.time_ms=1.362 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.593775] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.624Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b065b3efcc43c86e238162f7","created_at":"2026-10-06T14:49:46.509Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.513Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2584,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b065b3efcc43c86e238162f7: rescheduled"} gitlab # [ 258.603729] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.635Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b065b3efcc43c86e238162f7","created_at":"2026-10-06T14:49:46.509Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.513Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b065b3efcc43c86e238162f7: done: 0.666719 sec","job_status":"done","queue_duration_s":45.454729,"scheduling_latency_s":45.454744,"gitaly_calls":3,"gitaly_duration_s":0.232045,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.033217,"redis_read_bytes":460,"redis_write_bytes":29298,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001435,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002249,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.011669,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.005142,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15585,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.00776,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000557,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000486,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002484,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.149,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.023,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.117,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.253447,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.512489437,"duration_s":0.666719,"completed_at":"2026-10-06T14:50:32.635Z","load_balancing_strategy":"primary","db_duration_s":0.16204,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 258.668208] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.636Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a19aff1adb0d9b72e397bc88315b31884feb66bc 1ff64674a261f25f1aea4f39330a7ad87ce52348 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1910dd18ec2debc324d0ff49","created_at":"2026-10-06T14:50:28.754Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-a25f1cc4a36549eb","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:50:28.756Z","job_size_bytes":185,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1910dd18ec2debc324d0ff49: start","job_status":"start","queue_duration_s":3.879825,"scheduling_latency_s":3.879841} gitlab # [ 258.669230] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.644Z","message":"changes: \"a19aff1adb0d9b72e397bc88315b31884feb66bc 1ff64674a261f25f1aea4f39330a7ad87ce52348 refs/heads/master\\n\""} gitlab # [ 258.670080] gitaly[891]: time="2026-10-06T14:50:32.668Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:42.197" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:32.657" grpc.time_ms=10.92 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.731840] gitaly[891]: time="2026-10-06T14:50:32.763Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:50:42.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:32.753" grpc.time_ms=9.605 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.744598] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.768Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"57941564bb990e5465376949","created_at":"2026-10-06T14:50:32.766Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"32618e02c34e43470a3d6d04","job_size_bytes":46,"pid":2584,"job_status":"deduplicated","message":"ProjectCacheWorker JID-57941564bb990e5465376949: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 258.768728] gitaly[891]: time="2026-10-06T14:50:32.800Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-06T14:50:42.040" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:32.790" grpc.time_ms=9.928 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.782646] gitaly[891]: time="2026-10-06T14:50:32.814Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-06T14:51:02.803" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:32.804" grpc.time_ms=10.125 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.813788] gitaly[891]: time="2026-10-06T14:50:32.845Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-06T14:50:42.088" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-06T14:50:32.838" grpc.time_ms=6.864 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.833330] gitaly[891]: time="2026-10-06T14:50:32.864Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:42.103" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:32.854" grpc.time_ms=10.579 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.934543] gitaly[891]: time="2026-10-06T14:50:32.966Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-06T14:50:42.213" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:32.964" grpc.time_ms=1.331 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.963169] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.988Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a19aff1adb0d9b72e397bc88315b31884feb66bc 1ff64674a261f25f1aea4f39330a7ad87ce52348 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1910dd18ec2debc324d0ff49","created_at":"2026-10-06T14:50:28.754Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-a25f1cc4a36549eb","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:50:28.756Z","job_size_bytes":185,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1910dd18ec2debc324d0ff49: done: 0.352248 sec","job_status":"done","queue_duration_s":3.879825,"scheduling_latency_s":3.879841,"gitaly_calls":7,"gitaly_duration_s":0.182619,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.034427,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.001873,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001084,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004233,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.017612,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.009625,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.025,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.025,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.123581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000474642,"exclusive_lock_hold_duration_s":0.098344622,"duration_s":0.352248,"completed_at":"2026-10-06T14:50:32.988Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026912,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.015813] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.990Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"32618e02c34e43470a3d6d04","created_at":"2026-10-06T14:50:30.620Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.646Z","job_size_bytes":46,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-32618e02c34e43470a3d6d04: start","job_status":"start","queue_duration_s":2.344513,"scheduling_latency_s":2.344532} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348' gitlab # [ 259.016642] gitaly[891]: time="2026-10-06T14:50:33.028Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-06T20:50:33.022" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:33.022" grpc.time_ms=5.081 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.052785] gitaly[891]: time="2026-10-06T14:50:33.084Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=49 command.spawn_token_fork_ms=41 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-06T14:51:03.032" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.033" grpc.time_ms=50.891 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.077410] nixbot[2698]: INFO: ::ffff:127.0.0.1:35102 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.04 seconds) gitlab # [ 259.087372] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.118Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"32618e02c34e43470a3d6d04","created_at":"2026-10-06T14:50:30.620Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.646Z","job_size_bytes":46,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-32618e02c34e43470a3d6d04: done: 0.127884 sec","job_status":"done","queue_duration_s":2.344513,"scheduling_latency_s":2.344532,"gitaly_calls":2,"gitaly_duration_s":0.060516,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007567,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001721,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000777,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001463,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002871,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300038,"duration_s":0.127884,"completed_at":"2026-10-06T14:50:33.118Z","load_balancing_strategy":"primary","db_duration_s":0.014281,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.128466] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.120Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e97128485d2542f767e86501","created_at":"2026-10-06T14:50:30.666Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.672Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e97128485d2542f767e86501: start","job_status":"start","queue_duration_s":2.447802,"scheduling_latency_s":2.447819} gitlab # [ 259.140313] gitaly[891]: time="2026-10-06T14:50:33.172Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD diskcache=ab4c5449-47de-4b5b-a6ae-365451e97d79 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-06T20:50:33.137" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.138" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.141201] gitaly[891]: time="2026-10-06T14:50:33.172Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1285 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-06T20:50:33.137" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.138" grpc.time_ms=34.104 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.190105] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.221Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e97128485d2542f767e86501","created_at":"2026-10-06T14:50:30.666Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.672Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e97128485d2542f767e86501: done: 0.101182 sec","job_status":"done","queue_duration_s":2.447802,"scheduling_latency_s":2.447819,"gitaly_calls":1,"gitaly_duration_s":0.03706,"redis_calls":15,"redis_duration_s":0.003703,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001443,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000583,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.024,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07971376299999999,"duration_s":0.101182,"completed_at":"2026-10-06T14:50:33.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016661,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.192530] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.223Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"fafeb129f063065d2a5059bc","created_at":"2026-10-06T14:50:30.854Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.856Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-fafeb129f063065d2a5059bc: start","job_status":"start","queue_duration_s":2.366673,"scheduling_latency_s":2.3667} gitlab # [ 259.234962] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.264Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"fafeb129f063065d2a5059bc","created_at":"2026-10-06T14:50:30.854Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.856Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-fafeb129f063065d2a5059bc: done: 0.041137 sec","job_status":"done","queue_duration_s":2.366673,"scheduling_latency_s":2.3667,"gitaly_calls":1,"gitaly_duration_s":0.012448,"redis_calls":16,"redis_duration_s":0.004322,"redis_read_bytes":52,"redis_write_bytes":2046,"redis_queues_calls":1,"redis_queues_duration_s":0.00031,"redis_queues_read_bytes":1,"redis_queues_write_bytes":977,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001646,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041137,"completed_at":"2026-10-06T14:50:33.264Z","load_balancing_strategy":"primary","db_duration_s":0.003024,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.246531] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.265Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0c61f92910e0e438fd633efc","created_at":"2026-10-06T14:50:31.337Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6a0415031c179e8d1668422f321c3ed1878b19d3d387de5b6ddca54f1eca0132","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:31.344Z","job_size_bytes":467,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0c61f92910e0e438fd633efc: start","job_status":"start","queue_duration_s":1.921793,"scheduling_latency_s":1.92181} gitlab # [ 259.285444] gitaly[891]: time="2026-10-06T14:50:33.257Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-06T14:51:03.246" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.247" grpc.time_ms=10.594 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.286077] gitaly[891]: time="2026-10-06T14:50:33.284Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:03.283" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.283" grpc.time_ms=0.659 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.286731] gitaly[891]: time="2026-10-06T14:50:33.292Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-06T14:50:43.287" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:33.287" grpc.time_ms=5.259 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.337797] gitaly[891]: time="2026-10-06T14:50:33.369Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:03.368" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.368" grpc.time_ms=0.764 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.351717] gitaly[891]: time="2026-10-06T14:50:33.383Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=32 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-06T14:51:03.381" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.381" grpc.time_ms=2.253 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.448582] gitaly[891]: time="2026-10-06T14:50:33.480Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:43.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:33.468" grpc.time_ms=11.524 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.879875] gitaly[891]: time="2026-10-06T14:50:33.911Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-06T14:51:03.892" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.892" grpc.time_ms=18.8 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.926495] gitaly[891]: time="2026-10-06T14:50:33.958Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-06T14:51:03.048" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.948" grpc.time_ms=9.15 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.990443] sidekiq-cluster[2584]: {"severity":"WARN","time":"2026-10-06T14:50:34.021Z","class":"CreatePipelineWorker","correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"a19aff1adb0d9b72e397bc88315b31884feb66bc","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a19aff1adb0d9b72e397bc88315b31884feb66bc","ref":"refs/heads/master"},"retry":0} gitlab # [ 259.999846] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.030Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0c61f92910e0e438fd633efc","created_at":"2026-10-06T14:50:31.337Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6a0415031c179e8d1668422f321c3ed1878b19d3d387de5b6ddca54f1eca0132","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:31.344Z","job_size_bytes":467,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0c61f92910e0e438fd633efc: done: 0.765021 sec","job_status":"done","queue_duration_s":1.921793,"scheduling_latency_s":1.92181,"gitaly_calls":7,"gitaly_duration_s":0.143568,"redis_calls":51,"redis_duration_s":0.010224,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000865,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004144,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002517,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.573891,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000564038,"duration_s":0.765021,"completed_at":"2026-10-06T14:50:34.030Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047146,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348' gitlab # [ 260.063799] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.033Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"36075e5e-63e2-4bc6-a23b-ff8885e53566\"}"],"class":"WebHookWorker","jid":"3ae87903fe73394ada06fc8a","created_at":"2026-10-06T14:50:31.445Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5375b8baa898758642a05cd2d1adcd26aeba313f82e205b62561a33c2d2e05ab","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:31.450Z","job_size_bytes":1751,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3ae87903fe73394ada06fc8a: start","job_status":"start","queue_duration_s":2.5833,"scheduling_latency_s":2.583326} gitlab # [ 260.152130] nixbot[2698]: INFO: ::ffff:127.0.0.1:35124 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK gitlab # [ 260.157802] nixbot[2698]: INFO: ::ffff:127.0.0.1:35110 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.08 seconds) gitlab # [ 260.178675] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.210Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"36075e5e-63e2-4bc6-a23b-ff8885e53566\"}"],"class":"WebHookWorker","jid":"3ae87903fe73394ada06fc8a","created_at":"2026-10-06T14:50:31.445Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5375b8baa898758642a05cd2d1adcd26aeba313f82e205b62561a33c2d2e05ab","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:31.450Z","job_size_bytes":1751,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3ae87903fe73394ada06fc8a: done: 0.176573 sec","job_status":"done","queue_duration_s":2.5833,"scheduling_latency_s":2.583326,"redis_calls":19,"redis_duration_s":0.0045190000000000004,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001196,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000356,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001839,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.06731358299998647,"cpu_s":0.091643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000527162,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.176573,"completed_at":"2026-10-06T14:50:34.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.236433] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.213Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"37eb57b29c5bcb6f00c6d2cb","created_at":"2026-10-06T14:50:32.178Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.182Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-37eb57b29c5bcb6f00c6d2cb: start","job_status":"start","queue_duration_s":2.030975,"scheduling_latency_s":2.030992} gitlab # [ 260.237272] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"37eb57b29c5bcb6f00c6d2cb","created_at":"2026-10-06T14:50:32.178Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.182Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-37eb57b29c5bcb6f00c6d2cb: done: 0.051668 sec","job_status":"done","queue_duration_s":2.030975,"scheduling_latency_s":2.030992,"redis_calls":10,"redis_duration_s":0.001543,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201702,"duration_s":0.051668,"completed_at":"2026-10-06T14:50:34.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010747,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 260.280872] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.265Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"067bb03531abfc1c2a524d74","created_at":"2026-10-06T14:50:32.390Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.397Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-067bb03531abfc1c2a524d74: start","job_status":"start","queue_duration_s":1.868956,"scheduling_latency_s":1.868969} gitlab # [ 260.281695] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.288Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"067bb03531abfc1c2a524d74","created_at":"2026-10-06T14:50:32.390Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.397Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-067bb03531abfc1c2a524d74: done: 0.022097 sec","job_status":"done","queue_duration_s":1.868956,"scheduling_latency_s":1.868969,"redis_calls":10,"redis_duration_s":0.002908,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002337,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000328813,"duration_s":0.022097,"completed_at":"2026-10-06T14:50:34.288Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.339309] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.289Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c780a397fe695213dd798822","created_at":"2026-10-06T14:50:32.412Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.420Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c780a397fe695213dd798822: start","job_status":"start","queue_duration_s":1.868698,"scheduling_latency_s":1.868711} gitlab # [ 260.339969] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c780a397fe695213dd798822","created_at":"2026-10-06T14:50:32.412Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.420Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c780a397fe695213dd798822: done: 0.019867 sec","job_status":"done","queue_duration_s":1.868698,"scheduling_latency_s":1.868711,"redis_calls":10,"redis_duration_s":0.001307,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207568,"duration_s":0.019867,"completed_at":"2026-10-06T14:50:34.309Z","load_balancing_strategy":"primary","db_duration_s":0.002941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.363583] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 108 gitlab # [ 260.365092] gitlab-workhorse[822]: time="2026-10-06T14:50:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 260.366641] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 56 gitlab # [ 260.368986] gitaly[891]: time="2026-10-06T14:50:34.325Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3SVA5JMB32ZFMYQDDZH2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.319" grpc.time_ms=5.962 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 260.409131] gitaly[891]: time="2026-10-06T14:50:34.386Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3SYTVGYQSAYJCYQXTSY1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.377" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 260.410135] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.310Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"79d2784dd097a3f5c54181b5","created_at":"2026-10-06T14:50:32.437Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.444Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-79d2784dd097a3f5c54181b5: start","job_status":"start","queue_duration_s":1.865427,"scheduling_latency_s":1.865441} gitlab # [ 260.411515] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.346Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"79d2784dd097a3f5c54181b5","created_at":"2026-10-06T14:50:32.437Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.444Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-79d2784dd097a3f5c54181b5: done: 0.035976 sec","job_status":"done","queue_duration_s":1.865427,"scheduling_latency_s":1.865441,"redis_calls":13,"redis_duration_s":0.007659,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000966,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000437,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003566,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231314,"duration_s":0.035976,"completed_at":"2026-10-06T14:50:34.346Z","load_balancing_strategy":"primary","db_duration_s":0.005899,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.452918] gitlab-workhorse[822]: time="2026-10-06T14:50:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=336 gitlab # [ 260.453668] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 49 gitlab # [ 260.454248] gitaly[891]: time="2026-10-06T14:50:34.386Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3SYTVGYQSAYJCYQXTSY1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.377" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 260.459948] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.347Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e798064c49ed2bd63a60200f","created_at":"2026-10-06T14:50:32.445Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.451Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e798064c49ed2bd63a60200f: start","job_status":"start","queue_duration_s":1.896097,"scheduling_latency_s":1.896132} gitlab # [ 260.474942] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.372Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e798064c49ed2bd63a60200f","created_at":"2026-10-06T14:50:32.445Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.451Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e798064c49ed2bd63a60200f: done: 0.024747 sec","job_status":"done","queue_duration_s":1.896097,"scheduling_latency_s":1.896132,"redis_calls":10,"redis_duration_s":0.0013059999999999999,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225448,"duration_s":0.024747,"completed_at":"2026-10-06T14:50:34.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.529586] gitaly[891]: time="2026-10-06T14:50:34.386Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3SYTVGYQSAYJCYQXTSY1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.377" grpc.time_ms=9.01 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 260.530514] nixbot[2698]: {"ts": "2026-10-06T14:50:34.496Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 260.531027] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.375Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0996cff2f4dee09967da7016","created_at":"2026-10-06T14:50:32.452Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.459Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0996cff2f4dee09967da7016: start","job_status":"start","queue_duration_s":1.915408,"scheduling_latency_s":1.915423} gitlab # [ 260.573386] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.402Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0996cff2f4dee09967da7016","created_at":"2026-10-06T14:50:32.452Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.459Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0996cff2f4dee09967da7016: done: 0.02745 sec","job_status":"done","queue_duration_s":1.915408,"scheduling_latency_s":1.915423,"redis_calls":11,"redis_duration_s":0.004099,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001019,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002046,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201981,"duration_s":0.02745,"completed_at":"2026-10-06T14:50:34.402Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.584285] gitaly[891]: time="2026-10-06T14:50:34.438Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T0PQD3GZPVSF482A7MD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.425" pid=891 remote_ip="2001:db8:1::1" request_sha=5addf1005e54562888a2b30809824064671312f1 response_bytes=336 span.kind=server system=grpc gitlab # [ 260.593204] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.403Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"29cbedd9ea23664c0e4f5973","created_at":"2026-10-06T14:50:32.464Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.469Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-29cbedd9ea23664c0e4f5973: start","job_status":"start","queue_duration_s":1.933822,"scheduling_latency_s":1.933837} gitlab # [ 260.645346] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.426Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"29cbedd9ea23664c0e4f5973","created_at":"2026-10-06T14:50:32.464Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.469Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-29cbedd9ea23664c0e4f5973: done: 0.023063 sec","job_status":"done","queue_duration_s":1.933822,"scheduling_latency_s":1.933837,"redis_calls":10,"redis_duration_s":0.002251,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001382,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000364,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000831391,"duration_s":0.023063,"completed_at":"2026-10-06T14:50:34.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.650152] gitaly[891]: time="2026-10-06T14:50:34.438Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T0PQD3GZPVSF482A7MD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.425" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 260.662738] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.428Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"9ef9c0b5ba242da7a7f7daf0","created_at":"2026-10-06T14:50:32.471Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.476Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9ef9c0b5ba242da7a7f7daf0: start","job_status":"start","queue_duration_s":1.95161,"scheduling_latency_s":1.951625} gitlab # [ 260.702732] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"9ef9c0b5ba242da7a7f7daf0","created_at":"2026-10-06T14:50:32.471Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.476Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9ef9c0b5ba242da7a7f7daf0: done: 0.041684 sec","job_status":"done","queue_duration_s":1.95161,"scheduling_latency_s":1.951625,"redis_calls":10,"redis_duration_s":0.001689,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001045,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229917,"duration_s":0.041684,"completed_at":"2026-10-06T14:50:34.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.716635] nixbot[2698]: {"ts": "2026-10-06T14:50:34.667Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""} gitlab # [ 260.718754] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 160 gitlab # [ 260.721163] gitaly[891]: time="2026-10-06T14:50:34.438Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T0PQD3GZPVSF482A7MD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.425" grpc.time_ms=12.919 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 260.765757] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.471Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"172ed422750b60edd37c20fc","created_at":"2026-10-06T14:50:32.484Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.488Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-172ed422750b60edd37c20fc: start","job_status":"start","queue_duration_s":1.982581,"scheduling_latency_s":1.982597} gitlab # [ 260.766592] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.499Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"172ed422750b60edd37c20fc","created_at":"2026-10-06T14:50:32.484Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.488Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-172ed422750b60edd37c20fc: done: 0.028396 sec","job_status":"done","queue_duration_s":1.982581,"scheduling_latency_s":1.982597,"redis_calls":10,"redis_duration_s":0.002091,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000613,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212318,"duration_s":0.028396,"completed_at":"2026-10-06T14:50:34.499Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007151,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.807663] gitaly[891]: time="2026-10-06T14:50:34.556Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:04.554" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.555" grpc.time_ms=0.66 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.808460] nixbot[2698]: {"ts": "2026-10-06T14:50:34.827Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""} gitlab # [ 260.808940] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"45eb7e0b1efa21e1b9dc69db","created_at":"2026-10-06T14:50:32.489Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.493Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-45eb7e0b1efa21e1b9dc69db: start","job_status":"start","queue_duration_s":2.007349,"scheduling_latency_s":2.007364} gitlab # [ 260.852615] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.522Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"45eb7e0b1efa21e1b9dc69db","created_at":"2026-10-06T14:50:32.489Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.493Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-45eb7e0b1efa21e1b9dc69db: done: 0.021552 sec","job_status":"done","queue_duration_s":2.007349,"scheduling_latency_s":2.007364,"redis_calls":10,"redis_duration_s":0.0021809999999999998,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000344,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00156,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025115,"duration_s":0.021552,"completed_at":"2026-10-06T14:50:34.522Z","load_balancing_strategy":"primary","db_duration_s":0.002981,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.854568] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 156 gitlab # [ 260.856715] gitaly[891]: time="2026-10-06T14:50:34.628Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=10 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:44.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:34.614" grpc.time_ms=13.013 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.869687] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.523Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"62666a5864c2bceb3b354a4d","created_at":"2026-10-06T14:50:32.494Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.500Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-62666a5864c2bceb3b354a4d: start","job_status":"start","queue_duration_s":2.022695,"scheduling_latency_s":2.022709} gitlab # [ 260.883112] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"62666a5864c2bceb3b354a4d","created_at":"2026-10-06T14:50:32.494Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.500Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-62666a5864c2bceb3b354a4d: done: 0.025776 sec","job_status":"done","queue_duration_s":2.022695,"scheduling_latency_s":2.022709,"redis_calls":10,"redis_duration_s":0.001459,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212876,"duration_s":0.025776,"completed_at":"2026-10-06T14:50:34.549Z","load_balancing_strategy":"primary","db_duration_s":0.005426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.929703] gitaly[891]: time="2026-10-06T14:50:34.644Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 diskcache=f736bd00-bd6f-444f-9ec8-cb8f8777dbda grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-06T20:50:34.633" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.633" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.930494] gitaly[891]: time="2026-10-06T14:50:34.645Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-06T20:50:34.633" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.633" grpc.time_ms=11.276 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.971693] nixbot[2698]: {"ts": "2026-10-06T14:50:34.942Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""} gitlab # [ 260.972515] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.550Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"880696eaa0cb58418df7ee42","created_at":"2026-10-06T14:50:32.509Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.516Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-880696eaa0cb58418df7ee42: start","job_status":"start","queue_duration_s":2.03349,"scheduling_latency_s":2.033504} gitlab # [ 260.973713] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.593Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"880696eaa0cb58418df7ee42","created_at":"2026-10-06T14:50:32.509Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.516Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-880696eaa0cb58418df7ee42: done: 0.042885 sec","job_status":"done","queue_duration_s":2.03349,"scheduling_latency_s":2.033504,"redis_calls":14,"redis_duration_s":0.002164,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000336,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000245282,"duration_s":0.042885,"completed_at":"2026-10-06T14:50:34.592Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.030022] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 109 gitlab # [ 261.030680] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 42 gitlab # [ 261.031564] gitlab-workhorse[822]: time="2026-10-06T14:50:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 261.031983] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 45 gitlab # [ 261.032623] gitaly[891]: time="2026-10-06T14:50:34.675Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:04.674" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.674" grpc.time_ms=0.797 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.033767] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.594Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"37080f07e54c69ed79ca632b","created_at":"2026-10-06T14:50:32.625Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.627Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-37080f07e54c69ed79ca632b: start","job_status":"start","queue_duration_s":1.967171,"scheduling_latency_s":1.967187} gitlab # [ 261.034553] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.614Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"37080f07e54c69ed79ca632b","created_at":"2026-10-06T14:50:32.625Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.627Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-37080f07e54c69ed79ca632b: done: 0.020844 sec","job_status":"done","queue_duration_s":1.967171,"scheduling_latency_s":1.967187,"redis_calls":8,"redis_duration_s":0.002404,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001912,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020844,"completed_at":"2026-10-06T14:50:34.614Z","load_balancing_strategy":"primary","db_duration_s":0.002763,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 261.069326] gitaly[891]: time="2026-10-06T14:50:34.684Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-06T14:50:44.216" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:34.677" grpc.time_ms=6.856 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.081089] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.616Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f71db12a4db0698d18f4762c","created_at":"2026-10-06T14:50:32.773Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e97128485d2542f767e86501","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.774Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f71db12a4db0698d18f4762c: start","job_status":"start","queue_duration_s":1.841464,"scheduling_latency_s":1.84148} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348' gitlab # [ 261.123199] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.658Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f71db12a4db0698d18f4762c","created_at":"2026-10-06T14:50:32.773Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e97128485d2542f767e86501","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.774Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f71db12a4db0698d18f4762c: done: 0.041696 sec","job_status":"done","queue_duration_s":1.841464,"scheduling_latency_s":1.84148,"gitaly_calls":1,"gitaly_duration_s":0.01378,"redis_calls":12,"redis_duration_s":0.003432,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000542,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001654,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.027231674,"duration_s":0.041696,"completed_at":"2026-10-06T14:50:34.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.137230] gitaly[891]: time="2026-10-06T14:50:34.706Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:04.705" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.705" grpc.time_ms=0.617 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.148891] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.659Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fdb680241ca58f224bbbf26f","created_at":"2026-10-06T14:50:32.927Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:806c4a71afcb410a561b535532b46149a5281635f0dd3739cdb36af1c808450f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.929Z","job_size_bytes":467,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fdb680241ca58f224bbbf26f: start","job_status":"start","queue_duration_s":1.730283,"scheduling_latency_s":1.730299} gitlab # [ 261.201480] sidekiq-cluster[2584]: {"severity":"WARN","time":"2026-10-06T14:50:35.148Z","class":"CreatePipelineWorker","correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"a19aff1adb0d9b72e397bc88315b31884feb66bc","after":"1ff64674a261f25f1aea4f39330a7ad87ce52348","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"1ff64674a261f25f1aea4f39330a7ad87ce52348","ref":"refs/heads/master"},"retry":0} gitlab # [ 261.202306] gitaly[891]: time="2026-10-06T14:50:34.710Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=196 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-06T14:51:04.708" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.708" grpc.time_ms=1.958 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.06 seconds) gitlab # [ 261.203273] nixbot[2698]: INFO: ::ffff:127.0.0.1:35128 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 261.203715] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fdb680241ca58f224bbbf26f","created_at":"2026-10-06T14:50:32.927Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:806c4a71afcb410a561b535532b46149a5281635f0dd3739cdb36af1c808450f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.929Z","job_size_bytes":467,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fdb680241ca58f224bbbf26f: done: 0.492882 sec","job_status":"done","queue_duration_s":1.730283,"scheduling_latency_s":1.730299,"gitaly_calls":7,"gitaly_duration_s":0.074679,"redis_calls":33,"redis_duration_s":0.005322,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000436,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003435,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000688,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.399262,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.492882,"completed_at":"2026-10-06T14:50:35.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01162,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 261.227895] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.153Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"838901e6-d173-473d-952d-87f991c87673\"}"],"class":"WebHookWorker","jid":"04805f4c7e8dd624b4824e34","created_at":"2026-10-06T14:50:32.943Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d326489c3829b92da45fb096e5e6d941c691ea48433b642b060cf5da1757085a","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.947Z","job_size_bytes":1749,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-04805f4c7e8dd624b4824e34: start","job_status":"start","queue_duration_s":2.206402,"scheduling_latency_s":2.20642} gitlab # [ 261.243799] gitaly[891]: time="2026-10-06T14:50:34.740Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:44.272" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:34.733" grpc.time_ms=6.66 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.284651] nixbot[2698]: INFO: ::ffff:127.0.0.1:35138 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK gitlab # [ 261.285514] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.182Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"838901e6-d173-473d-952d-87f991c87673\"}"],"class":"WebHookWorker","jid":"04805f4c7e8dd624b4824e34","created_at":"2026-10-06T14:50:32.943Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d326489c3829b92da45fb096e5e6d941c691ea48433b642b060cf5da1757085a","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.947Z","job_size_bytes":1749,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-04805f4c7e8dd624b4824e34: done: 0.028882 sec","job_status":"done","queue_duration_s":2.206402,"scheduling_latency_s":2.20642,"redis_calls":14,"redis_duration_s":0.001811,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000261,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0057219560000021374,"cpu_s":0.01768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.028882,"completed_at":"2026-10-06T14:50:35.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.299252] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8c6ddf41e71a2d4bc6f3a183","created_at":"2026-10-06T14:50:33.098Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-8b54a1aad91e4f56","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:33.104Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8c6ddf41e71a2d4bc6f3a183: start","job_status":"start","queue_duration_s":2.07915,"scheduling_latency_s":2.079173} gitlab # [ 261.313738] gitaly[891]: time="2026-10-06T14:50:34.740Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T9EQR4VMDSEENJH9BTD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:04.538" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.738" grpc.time_ms=1.572 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.359139] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 90 gitlab # [ 261.359875] gitlab-workhorse[822]: time="2026-10-06T14:50:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 261.360493] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 51 gitlab # [ 261.361000] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.219Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8c6ddf41e71a2d4bc6f3a183","created_at":"2026-10-06T14:50:33.098Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-8b54a1aad91e4f56","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:33.104Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8c6ddf41e71a2d4bc6f3a183: done: 0.03561 sec","job_status":"done","queue_duration_s":2.07915,"scheduling_latency_s":2.079173,"redis_calls":19,"redis_duration_s":0.003551,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001117,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000487,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001395,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000552,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006224813,"duration_s":0.03561,"completed_at":"2026-10-06T14:50:35.219Z","load_balancing_strategy":"primary","db_duration_s":0.005188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.370703] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.221Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3ae87903fe73394ada06fc8a"],"class":"WebHooks::LogExecutionWorker","jid":"347dd3b1b395ad96eda21f93","created_at":"2026-10-06T14:50:34.194Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-5d44e6637c33462e","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c79aa03b4dc473464c6f7af101f0763acbd452329e458734ce3f8d9d0a389aca","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:34.201Z","job_size_bytes":2593,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-347dd3b1b395ad96eda21f93: start","job_status":"start","queue_duration_s":1.019451,"scheduling_latency_s":1.019466} gitlab # [ 261.420237] gitaly[891]: time="2026-10-06T14:50:34.783Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3T9EQR4VMDSEENJH9BTD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:44.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:34.777" grpc.time_ms=5.583 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.421303] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 40 gitlab # [ 261.421821] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.253Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3ae87903fe73394ada06fc8a"],"class":"WebHooks::LogExecutionWorker","jid":"347dd3b1b395ad96eda21f93","created_at":"2026-10-06T14:50:34.194Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-5d44e6637c33462e","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c79aa03b4dc473464c6f7af101f0763acbd452329e458734ce3f8d9d0a389aca","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:34.201Z","job_size_bytes":2593,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-347dd3b1b395ad96eda21f93: done: 0.032052 sec","job_status":"done","queue_duration_s":1.019451,"scheduling_latency_s":1.019466,"redis_calls":10,"redis_duration_s":0.00138,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212596,"duration_s":0.032052,"completed_at":"2026-10-06T14:50:35.253Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.469117] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.254Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"935594e855117f9b82a61220","created_at":"2026-10-06T14:50:34.653Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-f3816d2e40c34205","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:34.656Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-935594e855117f9b82a61220: start","job_status":"start","queue_duration_s":0.597933,"scheduling_latency_s":0.597947} gitlab # [ 261.470610] gitaly[891]: time="2026-10-06T14:50:34.868Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TEFZAQG7BCCJZBBXJFQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:04.867" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.867" grpc.time_ms=0.585 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.471544] gitlab-workhorse[822]: time="2026-10-06T14:50:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 261.472050] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 56 gitlab # [ 261.472586] gitaly[891]: time="2026-10-06T14:50:34.896Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3TEFZAQG7BCCJZBBXJFQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:44.278" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:34.889" grpc.time_ms=7.459 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.482123] gitaly[891]: time="2026-10-06T14:50:35.008Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3TJP9RGZGM018SRM5Z93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=200 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.001" grpc.time_ms=7.384 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.494833] gitaly[891]: time="2026-10-06T14:50:35.055Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TM3S5Q468F21R6H07Q9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.048" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 261.504556] gitaly[891]: time="2026-10-06T14:50:35.055Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TM3S5Q468F21R6H07Q9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.048" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.545609] gitaly[891]: time="2026-10-06T14:50:35.055Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TM3S5Q468F21R6H07Q9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.048" grpc.time_ms=6.843 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.546582] gitaly[891]: time="2026-10-06T14:50:35.106Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=958 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=9 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-06T14:51:05.092" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.092" grpc.time_ms=13.237 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.546754] gitaly[891]: time="2026-10-06T14:50:35.138Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=20 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-06T14:51:05.109" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.109" grpc.time_ms=29.381 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.588734] gitaly[891]: time="2026-10-06T14:50:35.282Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=53 command.spawn_token_fork_ms=47 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V3TSQZQ09V40TMRW2S37S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.227" grpc.time_ms=54.493 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.589620] gitaly[891]: time="2026-10-06T14:50:35.335Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TWM9DWS3YBAR8QRPGR6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.327" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 261.591215] gitaly[891]: time="2026-10-06T14:50:35.335Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TWM9DWS3YBAR8QRPGR6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.327" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.591953] gitaly[891]: time="2026-10-06T14:50:35.335Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TWM9DWS3YBAR8QRPGR6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.327" grpc.time_ms=7.975 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.604542] gitaly[891]: time="2026-10-06T14:50:35.434Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V3V031WFXHJSYEQF69Q16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.428" grpc.time_ms=6.624 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.616533] gitaly[891]: time="2026-10-06T14:50:35.476Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:35.475" grpc.time_ms=0.346 pid=891 span.kind=server system=grpc gitlab # [ 261.625278] gitaly[891]: time="2026-10-06T14:50:35.492Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V1D18V8Z7R19E0J2RES grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.479" pid=891 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 261.634959] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.651Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"935594e855117f9b82a61220","created_at":"2026-10-06T14:50:34.653Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-f3816d2e40c34205","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:34.656Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2584,"job_status":"rescheduled","message":"PipelineProcessWorker JID-935594e855117f9b82a61220: rescheduled"} gitlab # [ 261.684645] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.658Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"935594e855117f9b82a61220","created_at":"2026-10-06T14:50:34.653Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-f3816d2e40c34205","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:34.656Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-935594e855117f9b82a61220: done: 0.404635 sec","job_status":"done","queue_duration_s":0.597933,"scheduling_latency_s":0.597947,"gitaly_calls":3,"gitaly_duration_s":0.195656,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011141999999999999,"redis_read_bytes":148,"redis_write_bytes":18016,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000513,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000746,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002857,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12315,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003671,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00017,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000771,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001901,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.101,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.089,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097864,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.376975006,"duration_s":0.404635,"completed_at":"2026-10-06T14:50:35.658Z","load_balancing_strategy":"primary","db_duration_s":0.102938,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 261.731856] gitaly[891]: time="2026-10-06T14:50:35.493Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V1D18V8Z7R19E0J2RES grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.479" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.732843] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.661Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","04805f4c7e8dd624b4824e34"],"class":"WebHooks::LogExecutionWorker","jid":"425d9a9e8e68c14446e59e00","created_at":"2026-10-06T14:50:35.175Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-4d3db99fd4414152","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d603780844b1bde0e6d272d3a88b0c5a0d92b2c3ae09515a725be47b22d82f59","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.177Z","job_size_bytes":2592,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-425d9a9e8e68c14446e59e00: start","job_status":"start","queue_duration_s":0.483865,"scheduling_latency_s":0.483889} gitlab # [ 261.733412] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.682Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","04805f4c7e8dd624b4824e34"],"class":"WebHooks::LogExecutionWorker","jid":"425d9a9e8e68c14446e59e00","created_at":"2026-10-06T14:50:35.175Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-4d3db99fd4414152","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d603780844b1bde0e6d272d3a88b0c5a0d92b2c3ae09515a725be47b22d82f59","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.177Z","job_size_bytes":2592,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-425d9a9e8e68c14446e59e00: done: 0.021363 sec","job_status":"done","queue_duration_s":0.483865,"scheduling_latency_s":0.483889,"redis_calls":7,"redis_duration_s":0.001352,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021363,"completed_at":"2026-10-06T14:50:35.682Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.796882] gitaly[891]: time="2026-10-06T14:50:35.493Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V1D18V8Z7R19E0J2RES grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.479" grpc.time_ms=13.655 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.797639] nixbot[2698]: {"ts": "2026-10-06T14:50:35.775Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 \"HTTP/1.1 201 Created\""} gitlab # [ 261.798147] nixbot[2698]: {"ts": "2026-10-06T14:50:35.782Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-1ff64674a261-5"} gitlab # [ 261.798655] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.684Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"10943e5e8832967fb3df5cfc","created_at":"2026-10-06T14:50:35.208Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-879261acc7e74f11","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.212Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-10943e5e8832967fb3df5cfc: start","job_status":"start","queue_duration_s":0.471185,"scheduling_latency_s":0.471207} gitlab # [ 261.799436] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.752Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"10943e5e8832967fb3df5cfc","created_at":"2026-10-06T14:50:35.208Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-879261acc7e74f11","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.212Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-10943e5e8832967fb3df5cfc: done: 0.06842 sec","job_status":"done","queue_duration_s":0.471185,"scheduling_latency_s":0.471207,"redis_calls":11,"redis_duration_s":0.001826,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227962,"duration_s":0.06842,"completed_at":"2026-10-06T14:50:35.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.850908] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 250 gitlab # [ 261.851644] gitaly[891]: time="2026-10-06T14:50:35.501Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:35.500" grpc.time_ms=0.542 pid=891 span.kind=server system=grpc gitlab # [ 261.852512] gitaly[891]: time="2026-10-06T14:50:35.561Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:35.561" grpc.time_ms=0.28 pid=891 span.kind=server system=grpc gitlab # [ 261.857562] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.753Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"97f388bbd6f2da6332d49f5c","created_at":"2026-10-06T14:50:35.374Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.377Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-97f388bbd6f2da6332d49f5c: start","job_status":"start","queue_duration_s":0.376444,"scheduling_latency_s":0.376459} gitlab # [ 261.872727] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.788Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"97f388bbd6f2da6332d49f5c","created_at":"2026-10-06T14:50:35.374Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.377Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-97f388bbd6f2da6332d49f5c: done: 0.035313 sec","job_status":"done","queue_duration_s":0.376444,"scheduling_latency_s":0.376459,"redis_calls":7,"redis_duration_s":0.004631000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000374,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035313,"completed_at":"2026-10-06T14:50:35.788Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006368,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 261.917585] nixbot[2698]: {"ts": "2026-10-06T14:50:35.878Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-1ff64674a261-5", "argv0": "bwrap"} gitlab # [ 261.918396] gitaly[891]: time="2026-10-06T14:50:35.563Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:05.561" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.561" grpc.time_ms=1.262 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.960611] gitaly[891]: time="2026-10-06T14:50:35.572Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP diskcache=449a35e1-4d27-42af-b881-385676f3c330 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:05.383" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:35.383" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.961529] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.789Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0194d6b845983b2b40bcb3b5","created_at":"2026-10-06T14:50:35.577Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.579Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0194d6b845983b2b40bcb3b5: start","job_status":"start","queue_duration_s":0.209927,"scheduling_latency_s":0.209942} gitlab # [ 261.962223] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.806Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0194d6b845983b2b40bcb3b5","created_at":"2026-10-06T14:50:35.577Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.579Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0194d6b845983b2b40bcb3b5: done: 0.017012 sec","job_status":"done","queue_duration_s":0.209927,"scheduling_latency_s":0.209942,"redis_calls":7,"redis_duration_s":0.001422,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017012,"completed_at":"2026-10-06T14:50:35.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.004853] gitaly[891]: time="2026-10-06T14:50:35.572Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7404 command.oublock=0 command.real_time_ms=180 command.spawn_token_fork_ms=47 command.system_time_ms=45 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:05.383" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:35.383" grpc.time_ms=188.579 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.006128] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.808Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"27ab5f0be01baa5fa6c5736d","created_at":"2026-10-06T14:50:35.588Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.590Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-27ab5f0be01baa5fa6c5736d: start","job_status":"start","queue_duration_s":0.217338,"scheduling_latency_s":0.217353} gitlab # [ 262.013491] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.825Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"27ab5f0be01baa5fa6c5736d","created_at":"2026-10-06T14:50:35.588Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.590Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-27ab5f0be01baa5fa6c5736d: done: 0.017129 sec","job_status":"done","queue_duration_s":0.217338,"scheduling_latency_s":0.217353,"redis_calls":7,"redis_duration_s":0.001034,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017129,"completed_at":"2026-10-06T14:50:35.825Z","load_balancing_strategy":"primary","db_duration_s":0.002722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.064807] gitaly[891]: time="2026-10-06T14:50:35.579Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-06T14:51:05.569" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:35.570" grpc.time_ms=9.128 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.065889] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"73d495d01835806d5f5a231a","created_at":"2026-10-06T14:50:35.597Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.598Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-73d495d01835806d5f5a231a: start","job_status":"start","queue_duration_s":0.227627,"scheduling_latency_s":0.227641} gitlab # [ 262.077181] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.846Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"73d495d01835806d5f5a231a","created_at":"2026-10-06T14:50:35.597Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.598Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-73d495d01835806d5f5a231a: done: 0.02001 sec","job_status":"done","queue_duration_s":0.227627,"scheduling_latency_s":0.227641,"redis_calls":10,"redis_duration_s":0.001391,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000407,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02001,"completed_at":"2026-10-06T14:50:35.846Z","load_balancing_strategy":"primary","db_duration_s":0.004343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.116643] gitaly[891]: time="2026-10-06T14:50:35.592Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:45.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:35.585" grpc.time_ms=6.51 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.127826] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.847Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2240421d5cefc8c64e23e482","created_at":"2026-10-06T14:50:35.598Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.599Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2240421d5cefc8c64e23e482: start","job_status":"start","queue_duration_s":0.247483,"scheduling_latency_s":0.247496} gitlab # [ 262.143538] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.863Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2240421d5cefc8c64e23e482","created_at":"2026-10-06T14:50:35.598Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.599Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2240421d5cefc8c64e23e482: done: 0.016222 sec","job_status":"done","queue_duration_s":0.247483,"scheduling_latency_s":0.247496,"redis_calls":7,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016222,"completed_at":"2026-10-06T14:50:35.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348' gitlab # [ 262.189389] gitaly[891]: time="2026-10-06T14:50:35.609Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-06T14:50:45.028" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:35.608" grpc.time_ms=0.183 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.191313] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.865Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a7e9a52c5160818f6f865cdf","created_at":"2026-10-06T14:50:35.600Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.601Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a7e9a52c5160818f6f865cdf: start","job_status":"start","queue_duration_s":0.263903,"scheduling_latency_s":0.263948} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.04 seconds) (finished: subtest: push delivers the webhook, in 52.08 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses gitlab # [ 262.233130] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.911Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a7e9a52c5160818f6f865cdf","created_at":"2026-10-06T14:50:35.600Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.601Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a7e9a52c5160818f6f865cdf: done: 0.046598 sec","job_status":"done","queue_duration_s":0.263903,"scheduling_latency_s":0.263948,"redis_calls":8,"redis_duration_s":0.023811,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.023524,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046598,"completed_at":"2026-10-06T14:50:35.911Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.278202] gitaly[891]: time="2026-10-06T14:50:35.616Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-06T14:50:45.000" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:35.611" grpc.time_ms=5.199 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.279259] nixbot[2698]: INFO: ::ffff:127.0.0.1:35142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK gitlab # [ 262.279984] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.913Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a58941ce43c3a722884009b5","created_at":"2026-10-06T14:50:35.602Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.604Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a58941ce43c3a722884009b5: start","job_status":"start","queue_duration_s":0.308243,"scheduling_latency_s":0.308267} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.08 seconds) gitlab # [ 262.280627] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.929Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a58941ce43c3a722884009b5","created_at":"2026-10-06T14:50:35.602Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.604Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a58941ce43c3a722884009b5: done: 0.016502 sec","job_status":"done","queue_duration_s":0.308243,"scheduling_latency_s":0.308267,"redis_calls":7,"redis_duration_s":0.000975,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016502,"completed_at":"2026-10-06T14:50:35.929Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.326555] nix-daemon[2873]: accepted connection from pid 3697, user nixbot gitlab # [ 262.327305] gitaly[891]: time="2026-10-06T14:50:35.620Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:05.619" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.619" grpc.time_ms=0.632 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.328111] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.930Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6c0ed10f294aff1a31bf4dbf","created_at":"2026-10-06T14:50:35.605Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.606Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6c0ed10f294aff1a31bf4dbf: start","job_status":"start","queue_duration_s":0.324211,"scheduling_latency_s":0.324225} gitlab # [ 262.368713] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.947Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6c0ed10f294aff1a31bf4dbf","created_at":"2026-10-06T14:50:35.605Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.606Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6c0ed10f294aff1a31bf4dbf: done: 0.017155 sec","job_status":"done","queue_duration_s":0.324211,"scheduling_latency_s":0.324225,"redis_calls":7,"redis_duration_s":0.0009220000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017155,"completed_at":"2026-10-06T14:50:35.947Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004433,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.376444] gitaly[891]: time="2026-10-06T14:50:35.644Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:05.642" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.643" grpc.time_ms=1.343 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.387715] gitaly[891]: time="2026-10-06T14:50:35.655Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:35.653" grpc.time_ms=2.162 pid=891 span.kind=server system=grpc gitlab # [ 262.428307] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 57 gitlab # [ 262.429048] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.948Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2a6f9ea0ed637c06ba9cc15a","created_at":"2026-10-06T14:50:35.606Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.608Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2a6f9ea0ed637c06ba9cc15a: start","job_status":"start","queue_duration_s":0.3406,"scheduling_latency_s":0.340614} gitlab # [ 262.429690] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.958Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2a6f9ea0ed637c06ba9cc15a","created_at":"2026-10-06T14:50:35.606Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.608Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2a6f9ea0ed637c06ba9cc15a: done: 0.009361 sec","job_status":"done","queue_duration_s":0.3406,"scheduling_latency_s":0.340614,"redis_calls":7,"redis_duration_s":0.001043,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009361,"completed_at":"2026-10-06T14:50:35.957Z","load_balancing_strategy":"primary","db_duration_s":0.000763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.470872] gitaly[891]: time="2026-10-06T14:50:35.701Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:35.701" grpc.time_ms=0.353 pid=891 span.kind=server system=grpc gitlab # [ 262.471586] gitaly[891]: time="2026-10-06T14:50:35.712Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT diskcache=4ecc5918-ff73-45c0-985e-586f53bcee74 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:50:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:35.618" pid=891 ref=refs/keep-around/1ff64674a261f25f1aea4f39330a7ad87ce52348 remote_ip="2001:db8:1::1" revision=1ff64674a261f25f1aea4f39330a7ad87ce52348 span.kind=server system=grpc username=root gitlab # [ 262.472241] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.959Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"8d7c9ade68bb8018ff64e906","created_at":"2026-10-06T14:50:35.608Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.609Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-8d7c9ade68bb8018ff64e906: start","job_status":"start","queue_duration_s":0.349634,"scheduling_latency_s":0.349648} gitlab # [ 262.512361] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.973Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"8d7c9ade68bb8018ff64e906","created_at":"2026-10-06T14:50:35.608Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.609Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-8d7c9ade68bb8018ff64e906: done: 0.013753 sec","job_status":"done","queue_duration_s":0.349634,"scheduling_latency_s":0.349648,"redis_calls":7,"redis_duration_s":0.0009519999999999999,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013753,"completed_at":"2026-10-06T14:50:35.973Z","load_balancing_strategy":"primary","db_duration_s":0.002049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.552959] gitaly[891]: time="2026-10-06T14:50:35.712Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=45 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5085 command.oublock=8 command.real_time_ms=85 command.spawn_token_fork_ms=0 command.system_time_ms=31 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:50:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:35.618" grpc.time_ms=94.284 pid=891 ref=refs/keep-around/1ff64674a261f25f1aea4f39330a7ad87ce52348 remote_ip="2001:db8:1::1" revision=1ff64674a261f25f1aea4f39330a7ad87ce52348 span.kind=server system=grpc username=root gitlab # [ 262.553694] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.974Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3edd66defa0f5bd39c1ef902","created_at":"2026-10-06T14:50:35.652Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.653Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3edd66defa0f5bd39c1ef902: start","job_status":"start","queue_duration_s":0.320523,"scheduling_latency_s":0.320536} gitlab # [ 262.554522] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.989Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3edd66defa0f5bd39c1ef902","created_at":"2026-10-06T14:50:35.652Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.653Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3edd66defa0f5bd39c1ef902: done: 0.015095 sec","job_status":"done","queue_duration_s":0.320523,"scheduling_latency_s":0.320536,"redis_calls":8,"redis_duration_s":0.001046,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015095,"completed_at":"2026-10-06T14:50:35.989Z","load_balancing_strategy":"primary","db_duration_s":0.002015,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 262.597774] gitaly[891]: time="2026-10-06T14:50:35.716Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:05.715" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.715" grpc.time_ms=0.687 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.598635] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.990Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c18c76027f81d28a560f6722","created_at":"2026-10-06T14:50:35.718Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.721Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c18c76027f81d28a560f6722: start","job_status":"start","queue_duration_s":0.268641,"scheduling_latency_s":0.268654} gitlab # [ 262.636936] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.007Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c18c76027f81d28a560f6722","created_at":"2026-10-06T14:50:35.718Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.721Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c18c76027f81d28a560f6722: done: 0.017729 sec","job_status":"done","queue_duration_s":0.268641,"scheduling_latency_s":0.268654,"redis_calls":7,"redis_duration_s":0.001098,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017729,"completed_at":"2026-10-06T14:50:36.007Z","load_balancing_strategy":"primary","db_duration_s":0.003234,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 262.682251] gitaly[891]: time="2026-10-06T14:50:36.104Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:06.103" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:36.103" grpc.time_ms=1.072 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.682993] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.008Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6532193feb780337e894d95c","created_at":"2026-10-06T14:50:35.721Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.723Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6532193feb780337e894d95c: start","job_status":"start","queue_duration_s":0.285673,"scheduling_latency_s":0.285688} gitlab # [ 262.683590] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.045Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6532193feb780337e894d95c","created_at":"2026-10-06T14:50:35.721Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.723Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6532193feb780337e894d95c: done: 0.036892 sec","job_status":"done","queue_duration_s":0.285673,"scheduling_latency_s":0.285688,"redis_calls":10,"redis_duration_s":0.002025,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036892,"completed_at":"2026-10-06T14:50:36.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.722144] gitaly[891]: time="2026-10-06T14:50:36.132Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:06.131" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:36.132" grpc.time_ms=0.604 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.724708] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.046Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a06e6ce276664c4c111c1d4f","created_at":"2026-10-06T14:50:35.760Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.762Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a06e6ce276664c4c111c1d4f: start","job_status":"start","queue_duration_s":0.284566,"scheduling_latency_s":0.284589} gitlab # [ 262.739627] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.144Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a06e6ce276664c4c111c1d4f","created_at":"2026-10-06T14:50:35.760Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.762Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a06e6ce276664c4c111c1d4f: done: 0.097313 sec","job_status":"done","queue_duration_s":0.284566,"scheduling_latency_s":0.284589,"gitaly_calls":2,"gitaly_duration_s":0.006349,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004795,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000659,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000776,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00022,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000172,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000284,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064475,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06959432,"duration_s":0.097313,"completed_at":"2026-10-06T14:50:36.144Z","load_balancing_strategy":"primary","db_duration_s":0.025202,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 262.821219] gitaly[891]: time="2026-10-06T14:50:36.353Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3VWVCYRZZ1HMSFEYW01Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:06.152" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:36.352" grpc.time_ms=0.495 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.821904] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.145Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"79fe3675868ca03541cb3d05","created_at":"2026-10-06T14:50:36.089Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-0df7d481b39946bc","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:36.090Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-79fe3675868ca03541cb3d05: start","job_status":"start","queue_duration_s":0.054733,"scheduling_latency_s":0.054755} gitlab # [ 262.822540] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.169Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"79fe3675868ca03541cb3d05","created_at":"2026-10-06T14:50:36.089Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-0df7d481b39946bc","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:36.090Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-79fe3675868ca03541cb3d05: done: 0.024304 sec","job_status":"done","queue_duration_s":0.054733,"scheduling_latency_s":0.054755,"redis_calls":7,"redis_duration_s":0.001027,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024304,"completed_at":"2026-10-06T14:50:36.169Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00466,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses gitlab # [ 263.461528] gitaly[891]: time="2026-10-06T14:50:37.493Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3WZH8HVERE328ED4CARV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:07.491" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:37.491" grpc.time_ms=1.179 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 263.536071] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 141 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.20 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses gitlab # [ 264.645330] gitaly[891]: time="2026-10-06T14:50:38.676Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3Y4KTJP2S0Q8GT427101 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:08.474" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:38.674" grpc.time_ms=0.97 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 264.682689] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 101 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.15 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses gitlab # [ 265.790314] gitaly[891]: time="2026-10-06T14:50:39.821Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3Z8F5B1V5D5228C53MSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:09.619" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:39.820" grpc.time_ms=1.053 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.827186] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 98 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.14 seconds) gitlab # [ 266.671409] nix-daemon[2873]: accepted connection from pid 3735, user nixbot gitlab # [ 266.688561] nix-daemon[2873]: accepted connection from pid 3697, user nixbot gitlab # [ 266.801448] gitaly[891]: time="2026-10-06T14:50:40.832Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:10.830" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:40.831" grpc.time_ms=1.021 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses gitlab # [ 266.863525] gitaly[891]: time="2026-10-06T14:50:40.895Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:50.275" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:40.885" grpc.time_ms=9.242 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 266.941188] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:40.970Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5433ac301a945f0f104c65a8","created_at":"2026-10-06T14:50:40.963Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-172109a8ece84f1c","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:40.968Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5433ac301a945f0f104c65a8: start","job_status":"start","queue_duration_s":0.002204,"scheduling_latency_s":0.002258} gitlab # [ 266.981104] gitaly[891]: time="2026-10-06T14:50:41.012Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V40CXBFVBDF5X09KYF5P1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:11.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:41.010" grpc.time_ms=0.905 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 266.990556] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 258 gitlab # [ 266.993884] nixbot[2698]: {"ts": "2026-10-06T14:50:41.022Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 \"HTTP/1.1 201 Created\""} gitlab # [ 267.040106] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 146 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.21 seconds) gitlab # [ 267.096659] gitaly[891]: time="2026-10-06T14:50:41.128Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V40G125CYFX449SM424SC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:11.127" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:41.127" grpc.time_ms=0.549 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.128569] gitaly[891]: time="2026-10-06T14:50:41.160Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.160" grpc.time_ms=0.29 pid=891 span.kind=server system=grpc gitlab # [ 267.129613] gitaly[891]: time="2026-10-06T14:50:41.161Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V40G125CYFX449SM424SC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:51.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.153" grpc.time_ms=7.328 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.171662] gitaly[891]: time="2026-10-06T14:50:41.203Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.203" grpc.time_ms=0.281 pid=891 span.kind=server system=grpc gitlab # [ 267.182077] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 187 gitlab # [ 267.184499] nixbot[2698]: {"ts": "2026-10-06T14:50:41.214Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 \"HTTP/1.1 201 Created\""} gitlab # [ 267.202077] gitaly[891]: time="2026-10-06T14:50:41.233Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.233" grpc.time_ms=0.235 pid=891 span.kind=server system=grpc gitlab # [ 267.214262] gitaly[891]: time="2026-10-06T14:50:41.246Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" operations="[repack_refs]" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.221914] gitaly[891]: time="2026-10-06T14:50:41.253Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD diskcache=7cfa896c-370b-468f-90a1-b5fa7f3eb1a0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.222731] gitaly[891]: time="2026-10-06T14:50:41.254Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=127 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7443 command.oublock=0 command.real_time_ms=130 command.spawn_token_fork_ms=0 command.system_time_ms=91 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" grpc.time_ms=138.725 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.234405] gitaly[891]: time="2026-10-06T14:50:41.266Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V40PAQ836QA3A39A9VZYX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:11.265" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:41.265" grpc.time_ms=0.502 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.258677] gitaly[891]: time="2026-10-06T14:50:41.290Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" pid=891 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-06 14:49:34.245222624 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 267.275525] gitaly[891]: time="2026-10-06T14:50:41.307Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" pid=891 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 267.287924] gitaly[891]: time="2026-10-06T14:50:41.307Z" level=info msg="optimized repository" clean_stale_data_time=16.464663ms clean_work_trees_time="74.591µs" commit_graph_time="3.911µs" correlation_id=01M48V407T78E7CK8XB9QV2SWD gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.912µs" pid=891 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.47µs" storage_name=default system=housekeeping total_time=16.650161ms gitlab # [ 267.293889] gitaly[891]: time="2026-10-06T14:50:41.307Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.294542] gitaly[891]: time="2026-10-06T14:50:41.310Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V40PAQ836QA3A39A9VZYX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:51.154" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.304" grpc.time_ms=5.926 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.295222] gitaly[891]: time="2026-10-06T14:50:41.313Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:11.311" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:41.311" grpc.time_ms=1.119 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.313858] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 118 gitlab # [ 267.314827] nixbot[2698]: {"ts": "2026-10-06T14:50:41.346Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 \"HTTP/1.1 201 Created\""} gitlab # [ 267.344364] gitaly[891]: time="2026-10-06T14:50:41.376Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:11.375" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:41.375" grpc.time_ms=0.514 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.364117] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.395Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"54c65f180805929549050ce0","created_at":"2026-10-06T14:50:41.394Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"5433ac301a945f0f104c65a8","job_size_bytes":3,"pid":2584,"job_status":"deduplicated","message":"PipelineProcessWorker JID-54c65f180805929549050ce0: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 267.365809] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.397Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5433ac301a945f0f104c65a8","created_at":"2026-10-06T14:50:40.963Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-172109a8ece84f1c","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:40.968Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2584,"job_status":"rescheduled","message":"PipelineProcessWorker JID-5433ac301a945f0f104c65a8: rescheduled"} gitlab # [ 267.371425] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.402Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5433ac301a945f0f104c65a8","created_at":"2026-10-06T14:50:40.963Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-172109a8ece84f1c","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:40.968Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5433ac301a945f0f104c65a8: done: 0.432491 sec","job_status":"done","queue_duration_s":0.002204,"scheduling_latency_s":0.002258,"gitaly_calls":3,"gitaly_duration_s":0.146906,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.051248,"redis_read_bytes":239,"redis_write_bytes":21787,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000957,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.010863,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.009508,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14472,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.026532,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000258,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000456,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001717,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.076,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120626,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.330404004,"duration_s":0.432491,"completed_at":"2026-10-06T14:50:41.402Z","load_balancing_strategy":"primary","db_duration_s":0.084713,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 267.415886] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.407Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e8b2a4f78c1e8bbb50c643ea","created_at":"2026-10-06T14:50:41.107Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.109Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e8b2a4f78c1e8bbb50c643ea: start","job_status":"start","queue_duration_s":0.297595,"scheduling_latency_s":0.297629} gitlab # [ 267.416660] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.445Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e8b2a4f78c1e8bbb50c643ea","created_at":"2026-10-06T14:50:41.107Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.109Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e8b2a4f78c1e8bbb50c643ea: done: 0.038242 sec","job_status":"done","queue_duration_s":0.297595,"scheduling_latency_s":0.297629,"redis_calls":7,"redis_duration_s":0.001107,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038242,"completed_at":"2026-10-06T14:50:41.445Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014302,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 267.462696] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.446Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"008317c5e63142fb1658a916","created_at":"2026-10-06T14:50:41.259Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.261Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-008317c5e63142fb1658a916: start","job_status":"start","queue_duration_s":0.185578,"scheduling_latency_s":0.185593} gitlab # [ 267.466936] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.466Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"008317c5e63142fb1658a916","created_at":"2026-10-06T14:50:41.259Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.261Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-008317c5e63142fb1658a916: done: 0.020277 sec","job_status":"done","queue_duration_s":0.185578,"scheduling_latency_s":0.185593,"redis_calls":7,"redis_duration_s":0.0025859999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020277,"completed_at":"2026-10-06T14:50:41.466Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.510635] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8ecde3c7cb12ff704ac468ca","created_at":"2026-10-06T14:50:41.267Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.272Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8ecde3c7cb12ff704ac468ca: start","job_status":"start","queue_duration_s":0.196104,"scheduling_latency_s":0.196117} gitlab # [ 267.555668] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.491Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8ecde3c7cb12ff704ac468ca","created_at":"2026-10-06T14:50:41.267Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.272Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8ecde3c7cb12ff704ac468ca: done: 0.023697 sec","job_status":"done","queue_duration_s":0.196104,"scheduling_latency_s":0.196117,"redis_calls":7,"redis_duration_s":0.0046630000000000005,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00299,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001673,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023697,"completed_at":"2026-10-06T14:50:41.491Z","load_balancing_strategy":"primary","db_duration_s":0.004579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.599101] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.493Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"37695ebd2d96522977e37c55","created_at":"2026-10-06T14:50:41.278Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.280Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-37695ebd2d96522977e37c55: start","job_status":"start","queue_duration_s":0.212824,"scheduling_latency_s":0.212848} gitlab # [ 267.599868] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.523Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"37695ebd2d96522977e37c55","created_at":"2026-10-06T14:50:41.278Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.280Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-37695ebd2d96522977e37c55: done: 0.030559 sec","job_status":"done","queue_duration_s":0.212824,"scheduling_latency_s":0.212848,"redis_calls":10,"redis_duration_s":0.004889999999999999,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000417,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030559,"completed_at":"2026-10-06T14:50:41.523Z","load_balancing_strategy":"primary","db_duration_s":0.004999,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.652769] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.525Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3847edffa95da1ad57740656","created_at":"2026-10-06T14:50:41.280Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.281Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3847edffa95da1ad57740656: start","job_status":"start","queue_duration_s":0.243041,"scheduling_latency_s":0.24309} gitlab # [ 267.653425] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.548Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3847edffa95da1ad57740656","created_at":"2026-10-06T14:50:41.280Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.281Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3847edffa95da1ad57740656: done: 0.023814 sec","job_status":"done","queue_duration_s":0.243041,"scheduling_latency_s":0.24309,"redis_calls":7,"redis_duration_s":0.004894,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004533,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023814,"completed_at":"2026-10-06T14:50:41.548Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.702724] gitaly[891]: time="2026-10-06T14:50:41.662Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V412DW2A4X17FH6C1C8JH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.656" grpc.time_ms=5.789 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 267.703422] gitaly[891]: time="2026-10-06T14:50:41.711Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V413ZGYRJNPSFMARR3JFC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.705" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 267.703772] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 48 gitlab # [ 267.704390] gitlab-workhorse[822]: time="2026-10-06T14:50:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 267.704875] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 48 gitlab # [ 267.706542] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8032c112912ac90775178ea0","created_at":"2026-10-06T14:50:41.282Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.283Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8032c112912ac90775178ea0: start","job_status":"start","queue_duration_s":0.266226,"scheduling_latency_s":0.266244} gitlab # [ 267.715574] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.567Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8032c112912ac90775178ea0","created_at":"2026-10-06T14:50:41.282Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.283Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8032c112912ac90775178ea0: done: 0.017306 sec","job_status":"done","queue_duration_s":0.266226,"scheduling_latency_s":0.266244,"redis_calls":8,"redis_duration_s":0.001464,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001182,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017306,"completed_at":"2026-10-06T14:50:41.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.759156] gitaly[891]: time="2026-10-06T14:50:41.711Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V413ZGYRJNPSFMARR3JFC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.705" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 267.765531] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.568Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"70ac5d7cce3feff83b86470f","created_at":"2026-10-06T14:50:41.289Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.290Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-70ac5d7cce3feff83b86470f: start","job_status":"start","queue_duration_s":0.277483,"scheduling_latency_s":0.277499} gitlab # [ 267.808783] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.584Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"70ac5d7cce3feff83b86470f","created_at":"2026-10-06T14:50:41.289Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.290Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-70ac5d7cce3feff83b86470f: done: 0.01591 sec","job_status":"done","queue_duration_s":0.277483,"scheduling_latency_s":0.277499,"redis_calls":7,"redis_duration_s":0.001854,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001506,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01591,"completed_at":"2026-10-06T14:50:41.584Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001951,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.858646] gitaly[891]: time="2026-10-06T14:50:41.711Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V413ZGYRJNPSFMARR3JFC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.705" grpc.time_ms=6.626 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 267.859581] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 72 gitlab # [ 267.860299] gitlab-workhorse[822]: time="2026-10-06T14:50:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 267.860964] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 56 gitlab # [ 267.861806] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.585Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"22f40fd9943a3f919776b534","created_at":"2026-10-06T14:50:41.292Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.293Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-22f40fd9943a3f919776b534: start","job_status":"start","queue_duration_s":0.292319,"scheduling_latency_s":0.292338} gitlab # [ 267.862453] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.646Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"22f40fd9943a3f919776b534","created_at":"2026-10-06T14:50:41.292Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.293Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-22f40fd9943a3f919776b534: done: 0.061473 sec","job_status":"done","queue_duration_s":0.292319,"scheduling_latency_s":0.292338,"redis_calls":7,"redis_duration_s":0.002236,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061473,"completed_at":"2026-10-06T14:50:41.646Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.910371] gitaly[891]: time="2026-10-06T14:50:41.788Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.787" grpc.time_ms=0.338 pid=891 span.kind=server system=grpc gitlab # [ 267.911122] gitaly[891]: time="2026-10-06T14:50:41.808Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.807" grpc.time_ms=0.238 pid=891 span.kind=server system=grpc gitlab # [ 267.912932] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.648Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"dd75789bc7eee93dd915f8a5","created_at":"2026-10-06T14:50:41.296Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.297Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-dd75789bc7eee93dd915f8a5: start","job_status":"start","queue_duration_s":0.35043,"scheduling_latency_s":0.350479} gitlab # [ 267.961520] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.668Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"dd75789bc7eee93dd915f8a5","created_at":"2026-10-06T14:50:41.296Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.297Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-dd75789bc7eee93dd915f8a5: done: 0.020486 sec","job_status":"done","queue_duration_s":0.35043,"scheduling_latency_s":0.350479,"redis_calls":7,"redis_duration_s":0.0009989999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020486,"completed_at":"2026-10-06T14:50:41.668Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.968525] gitaly[891]: time="2026-10-06T14:50:41.810Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V416AC4YDWNFVRB3AF6K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.799" grpc.time_ms=10.449 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 268.013894] gitaly[891]: time="2026-10-06T14:50:41.828Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.827" grpc.time_ms=0.446 pid=891 span.kind=server system=grpc gitlab # [ 268.014738] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.669Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c7d438fe6466c96f6178838c","created_at":"2026-10-06T14:50:41.297Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.299Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c7d438fe6466c96f6178838c: start","job_status":"start","queue_duration_s":0.369965,"scheduling_latency_s":0.369978} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses gitlab # [ 268.015555] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c7d438fe6466c96f6178838c","created_at":"2026-10-06T14:50:41.297Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.299Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c7d438fe6466c96f6178838c: done: 0.008657 sec","job_status":"done","queue_duration_s":0.369965,"scheduling_latency_s":0.369978,"redis_calls":7,"redis_duration_s":0.000889,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008657,"completed_at":"2026-10-06T14:50:41.677Z","load_balancing_strategy":"primary","db_duration_s":0.000346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.063072] gitaly[891]: time="2026-10-06T14:50:41.838Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD diskcache=ccae2b26-566c-40e2-a969-d8711bb445c0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.766" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.766" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 268.063776] gitaly[891]: time="2026-10-06T14:50:41.839Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=64 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7259 command.oublock=0 command.real_time_ms=65 command.spawn_token_fork_ms=0 command.system_time_ms=42 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.766" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.766" grpc.time_ms=72.345 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 268.064377] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"1487f5151cc78b2f5d617cc5","created_at":"2026-10-06T14:50:41.299Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.300Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1487f5151cc78b2f5d617cc5: start","job_status":"start","queue_duration_s":0.378188,"scheduling_latency_s":0.378202} gitlab # [ 268.104089] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"1487f5151cc78b2f5d617cc5","created_at":"2026-10-06T14:50:41.299Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.300Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1487f5151cc78b2f5d617cc5: done: 0.024763 sec","job_status":"done","queue_duration_s":0.378188,"scheduling_latency_s":0.378202,"redis_calls":7,"redis_duration_s":0.0010249999999999999,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024763,"completed_at":"2026-10-06T14:50:41.703Z","load_balancing_strategy":"primary","db_duration_s":0.006218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.143788] gitaly[891]: time="2026-10-06T14:50:41.868Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V418MC122FE7NMPJBK82V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.860" pid=891 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.13 seconds) gitlab # [ 268.144680] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.705Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"9ac17bd50037dc7c40e9b6aa","created_at":"2026-10-06T14:50:41.398Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.399Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9ac17bd50037dc7c40e9b6aa: start","job_status":"start","queue_duration_s":0.30554,"scheduling_latency_s":0.305558} (finished: subtest: eval and build post commit statuses, in 5.91 seconds) (finished: run the VM test script, in 317.98 seconds) test script finished in 318.00s cleanup kill QemuMachine (pid 46) gitlab # [ 268.145483] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.917Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"9ac17bd50037dc7c40e9b6aa","created_at":"2026-10-06T14:50:41.398Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.399Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9ac17bd50037dc7c40e9b6aa: done: 0.212174 sec","job_status":"done","queue_duration_s":0.30554,"scheduling_latency_s":0.305558,"gitaly_calls":3,"gitaly_duration_s":0.07937,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016067,"redis_read_bytes":144,"redis_write_bytes":16877,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.002146,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001076,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":20,"redis_queues_duration_s":0.002857,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11226,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.005674,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000174,qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.92 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-06T14:49:43.897Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "unable to download 'https://cache.nixos.org/…': Could not resolve hostname (6) Could not resolve host: cache.nixos.org", 'count': 1}], 'error': None, 'created_at': '2026-10-06T14:50:35.517763Z', 'started_at': '2026-10-06T14:50:35.780262Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}] [{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': '2026-10-06T14:50:40.950Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': '2026-10-06T14:50:40.950Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-06T14:50:41.194Z', 'started_at': None, 'finished_at': '2026-10-06T14:50:41.328Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]