tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.ehajCrwsrd', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab # Discarding device blocks: 0/262144 done gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: 760d209d-669f-4139-ae5b-d898e144b4d5 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 (finished: start all VMs, in 51.71 seconds) gitlab # gitlab: waiting for unit setup-gitlab.service gitlab # Allocating group tables: 0/8 done gitlab: waiting for the VM to finish booting gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b2mz7sl3zr7lh25444rig6c7ib518gzb-nixos-system-gitlab-test/init regInfo=/nix/store/vn7ca6lxa9d531pi2y5np261gabh8n80-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 444221282 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000004] tsc: Detected 2400.008 MHz processor gitlab # [ 0.000811] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000878] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002777] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002787] Using GB pages for direct mapping gitlab # [ 0.002874] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002883] ACPI: Early table checksum verification disabled gitlab # [ 0.002886] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002890] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002894] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002900] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002902] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002904] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002905] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002907] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002908] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002909] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002910] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002910] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002911] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002911] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003136] No NUMA configuration found gitlab # [ 0.003137] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003139] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff] gitlab # [ 0.005498] Zone ranges: gitlab # [ 0.005499] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005500] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005501] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005502] Device empty gitlab # [ 0.005503] Movable zone start for each node gitlab # [ 0.005504] Early memory node ranges gitlab # [ 0.005504] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005505] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005506] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005507] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005527] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.005796] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.117978] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.118415] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.118430] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.118461] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.118464] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.118466] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.118467] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.118468] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.118469] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.118471] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.118472] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.118478] TSC deadline timer available gitlab # [ 0.118482] CPU topo: Max. logical packages: 1 gitlab # [ 0.118483] CPU topo: Max. logical dies: 1 gitlab # [ 0.118483] CPU topo: Max. dies per package: 1 gitlab # [ 0.118487] CPU topo: Max. threads per core: 1 gitlab # [ 0.118488] CPU topo: Num. cores per package: 4 gitlab # [ 0.118488] CPU topo: Num. threads per package: 4 gitlab # [ 0.118488] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.118512] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.118530] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.118532] kvm-guest: setup PV sched yield gitlab # [ 0.118547] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.118549] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.118550] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.118552] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.118553] Booting paravirtualized kernel on KVM gitlab # [ 0.118557] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.123018] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.125299] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.125347] kvm-guest: PV spinlocks enabled gitlab # [ 0.125349] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.125352] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b2mz7sl3zr7lh25444rig6c7ib518gzb-nixos-system-gitlab-test/init regInfo=/nix/store/vn7ca6lxa9d531pi2y5np261gabh8n80-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.125446] Unknown kernel command line parameters "regInfo=/nix/store/vn7ca6lxa9d531pi2y5np261gabh8n80-closure-info/registration", will be passed to user space. gitlab # [ 0.125459] random: crng init done gitlab # [ 0.125460] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.134562] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.138935] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.139010] software IO TLB: area num 4. gitlab # [ 0.215954] Fallback order for Node 0: 0 gitlab # [ 0.215962] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.215964] Policy zone: Normal gitlab # [ 0.218581] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.228163] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.242103] allocated 12582912 bytes of page_ext gitlab # [ 0.252431] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.252434] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.253289] Dynamic Preempt: lazy gitlab # [ 0.253437] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.253438] rcu: RCU event tracing is enabled. gitlab # [ 0.253439] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.253440] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.253440] Rude variant of Tasks RCU enabled. gitlab # [ 0.253441] Tracing variant of Tasks RCU enabled. gitlab # [ 0.253442] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.253442] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.253457] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.253459] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.253460] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.257834] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.258149] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.258156] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.258276] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.261900] Console: colour VGA+ 80x25 gitlab # [ 0.261903] printk: legacy console [tty0] enabled gitlab # [ 0.292798] printk: legacy console [ttyS0] enabled gitlab # [ 0.403516] ACPI: Core revision 20250807 gitlab # [ 0.404490] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.406183] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.407217] x2apic enabled gitlab # [ 0.407973] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.408941] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.410218] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.411719] kvm-guest: setup PV IPIs gitlab # [ 0.413304] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.414363] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.416131] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008) gitlab # [ 0.418213] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.419260] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.421128] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.422132] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.423128] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.424128] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.425128] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.426128] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.427128] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.429136] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.430129] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.431129] active return thunk: srso_alias_return_thunk gitlab # [ 0.432151] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.433128] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.434959] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.436128] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.437128] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.438128] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.439128] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.440129] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.441128] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.442128] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.443128] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.444944] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.445952] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.475631] Freeing SMP alternatives memory: 44K gitlab # [ 0.476131] pid_max: default: 32768 minimum: 301 gitlab # [ 0.477226] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.478230] landlock: Up and running. gitlab # [ 0.479128] Yama: becoming mindful. gitlab # [ 0.480143] LSM support for eBPF active gitlab # [ 0.481039] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.482281] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.485026] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.485696] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.486133] ... version: 2 gitlab # [ 0.486891] ... bit width: 48 gitlab # [ 0.487130] ... generic counters: 6 gitlab # [ 0.487890] ... generic bitmap: 000000000000003f gitlab # [ 0.488141] ... fixed-purpose counters: 0 gitlab # [ 0.488900] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.489130] ... value mask: 0000ffffffffffff gitlab # [ 0.490089] ... max period: 00007fffffffffff gitlab # [ 0.490868] ... global_ctrl mask: 000000000000003f gitlab # [ 0.491268] signal: max sigframe size: 3376 gitlab # [ 0.492080] rcu: Hierarchical SRCU implementation. gitlab # [ 0.492757] rcu: Max phase no-delay instances is 400. gitlab # [ 0.493362] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.498702] smp: Bringing up secondary CPUs ... gitlab # [ 0.499550] smpboot: x86: Booting SMP configuration: gitlab # [ 0.500133] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.503266] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.504879] smpboot: Total of 4 processors activated (19200.06 BogoMIPS) gitlab # [ 0.505464] Memory: 6011332K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved) gitlab # [ 0.507130] devtmpfs: initialized gitlab # [ 0.507969] x86/mm: Memory block size: 128MB gitlab # [ 0.510370] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.512145] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.513246] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.514444] PM: RTC time: 13:06:30, date: 2026-10-25 gitlab # [ 0.518590] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.520661] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.521194] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.523262] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.524144] audit: initializing netlink subsys (disabled) gitlab # [ 0.525191] audit: type=2000 audit(1792933590.933:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.525433] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.526132] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.527130] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.528130] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.529131] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.530164] cpuidle: using governor menu gitlab # [ 0.532327] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.533373] PCI: Using configuration type 1 for base access gitlab # [ 0.534132] PCI: Using configuration type 1 for extended access gitlab # [ 0.535305] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.537356] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.538132] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.539131] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.540130] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.543517] ACPI: Added _OSI(Module Device) gitlab # [ 0.544132] ACPI: Added _OSI(Processor Device) gitlab # [ 0.544926] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.547850] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.552143] ACPI: Interpreter enabled gitlab # [ 0.552840] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.553131] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.554015] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.555136] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.556166] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.561605] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.562137] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.565845] acpiphp: Slot [3] registered gitlab # [ 0.567169] acpiphp: Slot [4] registered gitlab # [ 0.569174] acpiphp: Slot [5] registered gitlab # [ 0.570173] acpiphp: Slot [6] registered gitlab # [ 0.571173] acpiphp: Slot [7] registered gitlab # [ 0.573189] acpiphp: Slot [8] registered gitlab # [ 0.574188] acpiphp: Slot [9] registered gitlab # [ 0.576183] acpiphp: Slot [10] registered gitlab # [ 0.577173] acpiphp: Slot [11] registered gitlab # [ 0.578189] acpiphp: Slot [12] registered gitlab # [ 0.580174] acpiphp: Slot [13] registered gitlab # [ 0.581151] acpiphp: Slot [14] registered gitlab # [ 0.581928] acpiphp: Slot [15] registered gitlab # [ 0.582151] acpiphp: Slot [16] registered gitlab # [ 0.582908] acpiphp: Slot [17] registered gitlab # [ 0.584149] acpiphp: Slot [18] registered gitlab # [ 0.584888] acpiphp: Slot [19] registered gitlab # [ 0.585151] acpiphp: Slot [20] registered gitlab # [ 0.585904] acpiphp: Slot [21] registered gitlab # [ 0.587150] acpiphp: Slot [22] registered gitlab # [ 0.587896] acpiphp: Slot [23] registered gitlab # [ 0.588151] acpiphp: Slot [24] registered gitlab # [ 0.588902] acpiphp: Slot [25] registered gitlab # [ 0.590150] acpiphp: Slot [26] registered gitlab # [ 0.590892] acpiphp: Slot [27] registered gitlab # [ 0.591159] acpiphp: Slot [28] registered gitlab # [ 0.591956] acpiphp: Slot [29] registered gitlab # [ 0.592693] acpiphp: Slot [30] registered gitlab # [ 0.594151] acpiphp: Slot [31] registered gitlab # [ 0.594907] PCI host bridge to bus 0000:00 gitlab # [ 0.595136] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.596131] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.597131] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.599131] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.600130] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.601131] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.602342] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.604624] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.606566] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.609169] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.610103] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.612043] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.612964] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.614040] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.615162] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.618163] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.620016] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.621341] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.623139] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.624597] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.648255] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.650162] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.652178] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.654450] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.658568] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.668142] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.669137] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.670152] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.682140] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.684784] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.689188] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.690143] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.691153] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.694978] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.703154] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.705151] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.707189] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.714545] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.722152] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.724151] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.727191] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.733076] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.742149] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.744146] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.746177] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.750198] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.754168] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.757153] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.759193] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.765503] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.776154] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.778151] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.780190] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.784150] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.789228] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.797165] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.800208] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.806490] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.814149] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.816146] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.818184] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.822090] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.826139] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.827074] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.828948] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.834154] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.835286] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.836277] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.838473] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.840293] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.845516] iommu: Default domain type: Translated gitlab # [ 0.847134] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.849689] ACPI: bus type USB registered gitlab # [ 0.851297] usbcore: registered new interface driver usbfs gitlab # [ 0.853185] usbcore: registered new interface driver hub gitlab # [ 0.855156] usbcore: registered new device driver usb gitlab # [ 0.859314] NetLabel: Initializing gitlab # [ 0.860090] NetLabel: domain hash size = 128 gitlab # [ 0.860710] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.861201] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.862139] PCI: Using ACPI for IRQ routing gitlab # [ 0.864309] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.865127] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.865127] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.867135] vgaarb: loaded gitlab # [ 0.867894] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.869130] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.874224] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.878198] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.878937] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.880616] pnp: PnP ACPI init gitlab # [ 0.881755] pnp: PnP ACPI: found 6 devices gitlab # [ 0.893456] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.897205] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.899741] NET: Registered PF_INET protocol family gitlab # [ 0.904807] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.935925] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.937463] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.938908] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.942696] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.944103] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.945706] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.947368] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.948841] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.950226] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.951255] NET: Registered PF_XDP protocol family gitlab # [ 0.952150] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 0.953221] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 0.954282] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 0.955449] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.956619] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.958019] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 0.959048] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 0.961474] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 0.964096] PCI: CLS 0 bytes, default 64 gitlab # [ 0.964880] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 0.965378] Trying to unpack rootfs image as initramfs... gitlab # [ 0.966009] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 0.966126] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.989292] Initialise system trusted keyrings gitlab # [ 0.990460] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 1.017660] Key type asymmetric registered gitlab # [ 1.019563] Asymmetric key parser 'x509' registered gitlab # [ 1.021864] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 1.025469] io scheduler mq-deadline registered gitlab # [ 1.027416] io scheduler kyber registered gitlab # [ 1.033581] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 1.036926] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 1.042369] Linux agpgart interface v0.103 gitlab # [ 1.044304] ACPI: bus type drm_connector registered gitlab # [ 1.048568] usbcore: registered new interface driver usbserial_generic gitlab # [ 1.050763] usbserial: USB Serial support registered for generic gitlab # [ 1.052782] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 1.052782] Please enable it if your BIOS has the CPPC option. gitlab # [ 1.057250] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 1.060023] drop_monitor: Initializing network drop monitor service gitlab # [ 1.062356] NET: Registered PF_INET6 protocol family gitlab # [ 1.065395] Segment Routing with IPv6 gitlab # [ 1.066748] In-situ OAM (IOAM) with IPv6 gitlab # [ 1.069438] IPI shorthand broadcast: enabled gitlab # [ 1.079458] sched_clock: Marking stable (929033922, 149971658)->(1102501485, -23495905) gitlab # [ 1.083669] registered taskstats version 1 gitlab # [ 1.087189] Loading compiled-in X.509 certificates gitlab # [ 1.104647] Demotion targets for Node 0: null gitlab # [ 1.105827] Key type .fscrypt registered gitlab # [ 1.106550] Key type fscrypt-provisioning registered gitlab # [ 1.107529] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.108495] ima: Allocated hash algorithm: sha1 gitlab # [ 1.109361] ima: No architecture policies found gitlab # [ 1.110493] PM: Magic number: 14:347:130 gitlab # [ 1.111299] acpi device:05: hash matches gitlab # [ 1.112878] RAS: Correctable Errors collector initialized. gitlab # [ 1.117443] clk: Disabling unused clocks gitlab # [ 1.118193] PM: genpd: Disabling unused power domains gitlab # [ 1.291137] Freeing initrd memory: 29392K gitlab # [ 1.298176] Freeing unused decrypted memory: 2028K gitlab # [ 1.304488] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.307238] Write protecting the kernel read-only data: 32768k gitlab # [ 1.312158] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.316104] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.384687] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.385829] Run /init as init process gitlab # [ 1.397407] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.418889] fuse: init (API version 7.45) gitlab # [ 1.427321] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.434001] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.437344] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.475710] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.811650] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.846781] systemd[1]: Detected virtualization kvm. gitlab # [ 1.849049] systemd[1]: Detected architecture x86-64. gitlab # [ 1.851218] systemd[1]: Running in initrd. gitlab # [ 1.853621] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.856545] systemd[1]: Hostname set to . gitlab # [ 1.969304] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 2.034413] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 2.044693] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 2.045928] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 2.048638] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 2.051035] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 2.053306] systemd[1]: Reached target Path Units. gitlab # [ 2.055068] systemd[1]: Reached target Slice Units. gitlab # [ 2.056856] systemd[1]: Reached target Swaps. gitlab # [ 2.058524] systemd[1]: Reached target Timer Units. gitlab # [ 2.060468] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 2.062850] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 2.065209] systemd[1]: Listening on Journal Sockets. gitlab # [ 2.066292] systemd[1]: Listening on udev Control Socket. gitlab # [ 2.067370] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 2.068375] systemd[1]: Reached target Socket Units. gitlab # [ 2.070427] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 2.072520] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 2.074574] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 2.082890] systemd[1]: Starting Journal Service... gitlab # [ 2.087059] systemd[1]: Starting Load Kernel Modules... gitlab # [ 2.088099] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 2.093552] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.102244] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.108098] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.117011] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.118628] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.124066] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.134515] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 2.137521] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 2.138237] netfs: FS-Cache loaded gitlab # [ 2.140079] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.142165] systemd-journald[92]: Collecting audit messages is disabled. gitlab # [ 2.145072] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 2.149132] 9pnet: Installing 9P2000 support gitlab # [ 2.152287] systemd[1]: Finished Load Kernel Modules. gitlab # [ 2.156149] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 2.158345] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 2.166335] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 2.168125] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 2.169711] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 2.170988] systemd[1]: Reached target Local File Systems. gitlab # [ 2.173049] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 2.175060] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 2.183889] systemd[1]: Started Journal Service. gitlab # [ 2.033994] systemd-modules-load[93]: Using 4 probe threads gitlab # [ 2.035923] systemd-modules-load[93]: Inserted module 'virtio_balloon' gitlab # [ 2.038325] systemd-modules-load[93]: Inserted module 'dm_mod' gitlab # [ 2.039338] systemd-modules-load[93]: Inserted module 'virtio_gpu' gitlab # [ 2.040335] systemd[1]: Starting Create System Files and Directories... gitlab # [ 2.046555] systemd-udevd[104]: Using default interface naming scheme 'v261'. gitlab # [ 2.050264] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.058133] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.091622] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.092760] systemd[1]: Reached target System Initialization. gitlab # [ 2.093520] systemd[1]: Reached target Basic System. gitlab # [ 2.319466] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.329990] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.330955] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.332045] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.332141] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.336498] SCSI subsystem initialized gitlab # [ 2.338747] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.339826] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.341100] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.342175] usb usb1: Product: UHCI Host Controller gitlab # [ 2.342873] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.343684] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.348276] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.359549] virtio_blk virtio5: [vdb] 11953296 512-byte logical blocks (6.12 GB/5.70 GiB) gitlab # [ 2.362254] hub 1-0:1.0: USB hub found gitlab # [ 2.363270] hub 1-0:1.0: 2 ports detected gitlab # [ 2.367701] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.371154] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.371955] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.391703] scsi host0: ata_piix gitlab # [ 2.251516] (udev-worker)[135]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.256285] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.259301] (udev-worker)[139]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.262170] (udev-worker)[139]: Network interface NamePolicy=[ 2.412245] scsi host1: ata_piix gitlab # disabled on kernel command line. gitlab # [ 2.413670] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.417687] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.274712] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.277187] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.278087] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.278863] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.280927] systemd-vconsole-setup[147]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.282480] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.305740] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.309586] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.576689] ata2: found unknown device (class 0) gitlab # [ 2.579501] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.583635] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.585073] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.620277] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.653192] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.682630] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.755391] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.758812] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.762358] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.764165] usb 1-1: Manufacturer: QEMU gitlab # [ 2.765809] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.798808] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.812235] usbcore: registered new interface driver usbhid gitlab # [ 2.814646] usbhid: USB HID core driver gitlab # [ 2.824122] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.828212] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.951170] systemd[1]: Mounting /sysroot... gitlab # [ 3.234731] EXT4-fs (vda): mounted filesystem 760d209d-669f-4139-ae5b-d898e144b4d5 r/w with ordered data mode. Quota mode: none. gitlab # [ 3.087956] systemd[1]: Mounted /sysroot. gitlab # [ 3.088670] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.090245] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.090993] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.091779] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.093271] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.095252] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.102115] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.109092] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.110890] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.111980] systemd-sysroot-fstab-check[176]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.263160] 9p: Installing v9fs 9p2000 file system support gitlab # [ 3.115075] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.118188] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.119765] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.120893] systemd[1]: rw-sysroot-nix-store.[ 3.271065] erofs (device vdb): mounted with root inode @ nid 128. gitlab # service: Deactivated successfully. gitlab # [ 3.122798] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.124412] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.126882] systemd[1]: Reload requested from client PID 176 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.128300] systemd[1]: Reloading... gitlab # [ 3.184589] systemd[1]: Reloading finished in 55 ms. gitlab # [ 3.208987] systemd-sysroot-fstab-check[176]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.210902] systemd-sysroot-fstab-check[176]: Requesting swap.target/start/replace... gitlab # [ 3.212618] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.215153] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.219776] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.221318] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.224969] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.226629] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.949852] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.972409] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.973186] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.973940] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.974848] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.989833] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.990947] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.999129] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.999861] systemd[1]: Reached target Initrd Default Target. gitlab # [ 4.000735] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.013975] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.014857] systemd[1]: Stopped target Basic System. gitlab # [ 4.015516] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.016257] systemd[1]: Stopped target Path Units. gitlab # [ 4.016975] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.018051] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.019113] systemd[1]: Stopped target Slice Units. gitlab # [ 4.019764] systemd[1]: Stopped target Socket Units. gitlab # [ 4.020450] systemd[1]: Stopped target System Initialization. gitlab # [ 4.021262] systemd[1]: Stopped target Swaps. gitlab # [ 4.021878] systemd[1]: Stopped target Timer Units. gitlab # [ 4.022531] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.023385] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.024603] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.025812] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.026581] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.028220] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.029156] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.030308] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.031125] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.032378] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.033163] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.034272] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.035349] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.036430] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.037360] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.038180] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.039149] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.040145] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.040953] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.041980] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.043019] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.043723] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.044680] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.045544] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.046779] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.048335] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.049735] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.053185] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.054167] systemd[1]: Closed udev Control Socket. gitlab # [ 4.055670] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.056483] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.057600] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.058537] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.059615] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.060625] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.061653] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.077728] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.078845] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.079606] systemd[1]: Reached target Switch Root. gitlab # [ 4.080324] systemd[1]: Starting NixOS Activation... gitlab # [ 4.145031] initrd-nixos-activation-start[224]: booting system configuration /nix/store/b2mz7sl3zr7lh25444rig6c7ib518gzb-nixos-system-gitlab-test gitlab # [ 4.162676] initrd-nixos-activation-start[224]: running activation script... gitlab # [ 4.364996] initrd-nixos-activation-start[248]: setting up /etc... gitlab # [ 4.440992] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.443531] systemd[1]: Finished NixOS Activation. gitlab # [ 4.445528] systemd[1]: Starting Switch Root... gitlab # [ 4.486314] systemd[1]: Switching root. gitlab # [ 4.708263] systemd-journald[92]: Received SIGTERM from PID 1 (systemd). gitlab # [ 4.810334] NET: Registered PF_VSOCK protocol family gitlab # [ 5.172020] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.177392] systemd[1]: Detected virtualization kvm. gitlab # [ 5.178916] systemd[1]: Detected architecture x86-64. gitlab # [ 5.180515] systemd[1]: Detected first boot. gitlab # [ 5.182567] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.313202] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.366582] systemd[1]: Applying preset policy. gitlab # [ 5.471111] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 5.578709] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 5.580115] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 5.582511] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 5.584466] systemd[1]: Created slice Slice /system/getty. gitlab # [ 5.586094] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 5.587517] systemd[1]: Created slice User and Session Slice. gitlab # [ 5.588489] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.589794] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 5.590918] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 5.591633] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 5.592438] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 5.593352] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 5.594179] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 5.595022] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 5.595900] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 5.596855] systemd[1]: Reached target Path Units. gitlab # [ 5.597569] systemd[1]: Reached target Remote File Systems. gitlab # [ 5.598389] systemd[1]: Reached target Slice Units. gitlab # [ 5.599175] systemd[1]: Reached target Swaps. gitlab # [ 5.600606] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 5.602661] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 5.604071] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 5.605631] systemd[1]: Listening on Factory Reset Management. gitlab # [ 5.606611] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 5.608917] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 5.610389] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 5.612297] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 5.613525] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 5.614726] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.616218] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 5.619048] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 5.620141] systemd[1]: Listening on udev Control Socket. gitlab # [ 5.621094] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 5.623713] systemd[1]: Mounting Huge Pages File System... gitlab # [ 5.625621] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 5.627539] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 5.630273] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 5.641849] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 5.646387] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 5.682654] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 5.685025] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 5.688525] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.691935] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.696728] systemd[1]: Mounting FUSE Control File System... gitlab # [ 5.698552] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.711145] systemd[1]: Starting Journal Service... gitlab # [ 5.714823] systemd[1]: Starting Load Kernel Modules... gitlab # [ 5.719258] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 5.728249] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 5.729240] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.732011] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 5.734665] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 5.736289] systemd[1]: Mounted Huge Pages File System. gitlab # [ 5.738037] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 5.740936] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 5.742777] systemd-journald[318]: Collecting audit messages is enabled. gitlab # [ 5.749215] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 5.753113] loop: module loaded gitlab # [ 5.753297] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 5.755352] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 5.756054] EXT4-fs (vda): re-mounted 760d209d-669f-4139-ae5b-d898e144b4d5. gitlab # [ 5.756761] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 5.758470] systemd[1]: Mounted FUSE Control File System. gitlab # [ 5.763121] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 5.613899] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 5.616260] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 5.617372] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 5.618692] systemd-modules-load[319]: Using 3 probe threads gitlab # [ 5.768593] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 5.619789] systemd-modules-load[319]: Inserted module 'loop' gitlab # [ 5.621418] systemd-modules-load[319]: Inserted module 'tls' gitlab # [ 5.772409] systemd[1]: Started Journal Service. gitlab # [ 5.625875] systemd[1]: Finished Load Kernel Modules. gitlab # [ 5.626853] systemd-oomd[320]: No swap; memory pressure usage will be degraded gitlab # [ 5.638459] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 5.640108] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 5.646483] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 5.649742] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 5.650963] systemd[1]: Starting Firewall... gitlab # [ 5.651891] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 5.653647] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 5.655707] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 5.660326] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 5.661160] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.666441] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 5.669526] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 5.825619] systemd-journald[318]: Received client request to flush runtime journal. gitlab # [ 5.709917] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 5.711424] systemd[1]: Reached target First Boot Complete. gitlab # [ 5.712333] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 5.713120] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 5.714042] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 5.715051] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 5.716322] systemd-udevd[352]: Using default interface naming scheme 'v261'. gitlab # [ 5.717357] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 5.736059] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 5.743394] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 5.812093] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.829025] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 5.838439] (udev-worker)[429]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 5.842962] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 5.854870] (udev-worker)[419]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 5.856961] (udev-worker)[419]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 5.866317] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 5.867488] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.869034] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.871142] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 5.872615] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.874114] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.896642] systemd[1]: Finished Firewall. gitlab # [ 6.051220] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.064043] Console: switching to colour dummy device 80x25 gitlab # [ 6.064862] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.065739] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.066762] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.067645] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.068099] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.068416] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.070941] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.071879] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.078916] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.079207] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4 gitlab # [ 6.079812] ACPI: button: Power Button [PWRF] gitlab # [ 6.080547] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.090819] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 gitlab # [ 6.099661] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 6.104513] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.106543] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.109437] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.110086] rtc_cmos 00:05: setting system clock to 2026-10-25T13:06:36 UTC (1792933596) gitlab # [ 6.111150] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.112348] FDC 0 is a S82078B gitlab # [ 6.113189] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.114580] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.115760] systemd-journald[318]: Time jumped backwards, rotating. gitlab # [ 6.011229] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.017900] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.019146] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.020412] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.193985] ppdev: user-space parallel port driver gitlab # [ 6.044113] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.045661] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.049142] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.096448] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.099242] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.280685] kvm_amd: TSC scaling supported gitlab # [ 6.281245] kvm_amd: Nested Virtualization enabled gitlab # [ 6.281734] kvm_amd: Nested Paging enabled gitlab # [ 6.282229] kvm_amd: LBR virtualization supported gitlab # [ 6.282715] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.283288] kvm_amd: Virtual GIF supported gitlab # [ 6.283713] kvm_amd: Virtual NMI enabled gitlab # [ 6.363844] EDAC MC: Ver: 3.0.0 gitlab # [ 6.433480] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.454738] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.457425] systemd[1]: Reached target Local File Systems. gitlab # [ 6.460686] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.465119] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.469358] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.471503] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.480443] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.484237] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.516176] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.518678] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.529644] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.534913] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.537200] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 6.554875] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 6.569356] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 6.571917] systemd[1]: Starting Update is Completed... gitlab # [ 6.585536] systemd[1]: Finished Update is Completed. gitlab # [ 6.623516] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 6.625811] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 6.836654] systemd[1]: Finished register-nix-paths.service. gitlab # [ 6.838096] systemd[1]: Reached target System Initialization. gitlab # [ 6.839357] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 6.840705] systemd[1]: Started logrotate.timer. gitlab # [ 6.841768] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 6.843156] systemd[1]: Reached target Timer Units. gitlab # [ 6.844328] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 6.845633] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 6.850285] systemd[1]: Starting nixbot CI service socket... gitlab # [ 6.851497] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 6.853183] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 6.854605] systemd[1]: Reached target Socket Units. gitlab # [ 6.858809] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 6.918564] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 6.922075] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync' gitlab # [ 6.925070] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 6.931187] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 6.942375] dbus-broker-launch[577]: Ready gitlab # [ 6.945437] systemd[1]: Reached target Basic System. gitlab # [ 6.948420] systemd[1]: Started backdoor.service. gitlab # [ 6.954729] systemd[1]: Starting gitlab-config.service... gitlab # [ 6.963145] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 6.967501] systemd[1]: Starting Logrotate configuration check... gitlab # [ 6.977574] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 6.983443] systemd[1]: Starting Post-Boot Actions... gitlab # [ 6.987953] systemd[1]: Started Reset console on configuration changes. gitlab # [ 6.990241] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 6.994161] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # [ 6.997069] logrotate[582]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 6.998824] logrotate[582]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.000444] logrotate[582]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.003590] logrotate[582]: Allocating hash table for state file, size 64 entries gitlab # connecting to host... gitlab # [ 7.007125] logrotate[582]: Handling 4 logs gitlab # [ 7.008093] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.008654] logrotate[582]: considering log /var/log/btmp gitlab # [ 7.009173] logrotate[582]: Creating new state gitlab # [ 7.009618] logrotate[582]: Now: 2026-10-25 13:06 gitlab # [ 7.011432] logrotate[582]: Last rotated at 2026-10-25 13:00 gitlab # [ 7.012104] logrotate[582]: log does not need rotating (log has already been rotated) gitlab # [ 7.012838] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.013386] logrotate[582]: considering log /var/log/wtmp gitlab # [ 7.013866] logrotate[582]: Creating new state gitlab # [ 7.014329] logrotate[582]: Now: 2026-10-25 13:06 gitlab # [ 7.014870] logrotate[582]: Last rotated at 2026-10-25 13:00 gitlab # [ 7.015666] logrotate[582]: log does not need rotating (log has already been rotated) gitlab # [ 7.016588] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.016749] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582) gitlab # [ 7.019300] logrotate[582]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.020052] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.020472] logrotate[582]: Creating new state gitlab # [ 7.020981] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582) gitlab # [ 7.021622] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.022213] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582) gitlab # [ 7.022930] logrotate[582]: considering log /var/log/nginx/*.log gitlab # [ 7.023605] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.024435] logrotate[582]: Creating new state gitlab # [ 7.024896] logrotate[582]: not running postrotate script, since no logs were rotated gitlab # [ 7.025510] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582) gitlab # [ 7.026211] systemd[1]: Starting resolvconf update... gitlab # [ 7.036381] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.037156] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.041667] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.045701] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.046728] nsncd[585]: Oct 25 13:06:37.585 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.047516] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.047957] systemd[1]: Reached target User and Group Name Lookups. gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.053931] systemd[1]: Starting User Login Management... gitlab: connected to guest root shell gitlab: (connecting took 7.66 seconds) gitlab: (finished: waiting for the VM to finish booting, in 7.66 seconds) gitlab # [ 7.068991] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.069675] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.070208] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.070682] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.072361] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.074210] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.076371] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.077147] systemd[1]: nscd.service: Consumed 20ms CPU time over 97ms wall clock time, 7.2M memory peak, 5.5M read from disk. gitlab # [ 7.081909] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.100084] systemd-logind[636]: New seat seat0. gitlab # [ 7.100812] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.101554] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.102432] nsncd[669]: Oct 25 13:06:37.640 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.104583] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.110643] systemd-logind[636]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.111484] systemd-logind[636]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 7.111991] systemd-logind[636]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.112438] systemd[1]: Started User Login Management. gitlab # [ 7.115039] systemd[1]: Starting linger-users.service... gitlab # [ 7.117854] systemd[1]: Finished resolvconf update. gitlab # [ 7.119301] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.122288] systemd[1]: Starting DHCP Client... gitlab # [ 7.124375] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.132705] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.134293] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.134941] systemd[1]: Finished linger-users.service. gitlab # [ 7.152117] network-addresses-eth1-start[699]: adding address 192.168.1.1/24... done gitlab # [ 7.156259] network-addresses-eth1-start[699]: adding address 2001:db8:1::1/64... done gitlab # [ 7.160873] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.182776] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.183601] systemd[1]: Reached target Network. gitlab # [ 7.185105] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.188841] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.189923] systemd[1]: Starting PostgreSQL Server... gitlab # [ 7.194314] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 7.196297] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.200281] dhcpcd[725]: dhcpcd-10.3.2 starting gitlab # [ 7.201787] dhcpcd[770]: dev: loaded udev gitlab # [ 7.356877] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.357771] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 7.212859] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.217397] systemd[1]: Started Getty on tty1. gitlab # [ 7.219985] systemd[1]: Reached target Login Prompts. gitlab # [ 7.223611] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.437676] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 7.443314] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 7.444812] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 7.446776] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 7.448111] cfg80211: failed to load regulatory.db gitlab # [ 7.315271] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.315956] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.316582] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started gitlab # [ 7.319571] redis-server[788]: Configuration loaded gitlab # [ 7.320423] redis[788]: monotonic clock: POSIX clock_gettime gitlab # [ 7.321963] redis[788]: Running mode=standalone, port=0. gitlab # [ 7.322749] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.322913] redis[788]: Server initialized gitlab # [ 7.323648] redis[788]: Ready to accept connections unix gitlab # [ 7.324223] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.324994] nginx-pre-start[792]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.326044] nginx-pre-start[792]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.326947] postgresql-pre-start[794]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.327691] postgresql-pre-start[794]: This user must also own the server process. gitlab # [ 7.332873] postgresql-pre-start[794]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.333537] postgresql-pre-start[794]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.333926] postgresql-pre-start[794]: The default text search configuration will be set to "english". gitlab # [ 7.334663] postgresql-pre-start[794]: Data page checksums are enabled. gitlab # [ 7.335762] postgresql-pre-start[794]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.338945] postgresql-pre-start[794]: creating subdirectories ... ok gitlab # [ 7.339483] postgresql-pre-start[794]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.340090] systemd[1]: Started Nginx Web Server. gitlab # [ 7.496248] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.348585] dhcpcd[770]: eth0: waiting for carrier gitlab # [ 7.350617] dhcpcd[770]: eth0: carrier acquired gitlab # [ 7.356927] dhcpcd[770]: DUID 00:01:00:01:32:70:bb:5d:52:54:00:12:34:56 gitlab # [ 7.357600] dhcpcd[770]: eth0: IAID 00:12:34:56 gitlab # [ 7.358232] dhcpcd[770]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.370202] postgresql-pre-start[794]: selecting default "max_connections" ... 100 gitlab # [ 7.419773] postgresql-pre-start[794]: selecting default "shared_buffers" ... 128MB gitlab # [ 7.633241] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 7.777952] postgresql-pre-start[794]: selecting default time zone ... UTC gitlab # [ 7.779293] postgresql-pre-start[794]: creating configuration files ... ok gitlab # [ 7.810831] gitlab-workhorse[825]: time="2026-10-25T13:06:38Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 7.811492] gitlab-workhorse[825]: time="2026-10-25T13:06:38Z" level=info msg="Using redis/go-redis" gitlab # [ 7.815050] gitlab-workhorse[825]: time="2026-10-25T13:06:38Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 7.930906] postgresql-pre-start[794]: running bootstrap script ... ok gitlab # [ 8.035331] dhcpcd[770]: eth0: soliciting a DHCP lease gitlab # [ 8.189867] NET: Registered PF_PACKET protocol family gitlab # [ 8.047730] dhcpcd[770]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 8.055246] dhcpcd[770]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.318191] postgresql-pre-start[794]: performing post-bootstrap initialization ... ok gitlab # [ 8.523526] postgresql-pre-start[794]: syncing data to disk ... ok gitlab # [ 8.524529] postgresql-pre-start[794]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 8.525458] postgresql-pre-start[794]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 8.526213] postgresql-pre-start[794]: Success. You can now start the database server using: gitlab # [ 8.526878] postgresql-pre-start[794]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 8.643038] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 8.644751] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 8.645500] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 8.649503] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 8.659701] postgres[860]: [860] LOG: database system was shut down at 2026-10-25 13:06:38 GMT gitlab # [ 8.667510] postgres[851]: [851] LOG: database system is ready to accept connections gitlab # [ 8.672372] systemd[1]: Started PostgreSQL Server. gitlab # [ 8.674558] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 8.865589] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[871]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 8.867128] postgresql-setup-start[875]: CREATE DATABASE gitlab # [ 8.868324] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[871]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 8.896819] postgresql-setup-start[890]: CREATE ROLE gitlab # [ 8.904846] postgresql-setup-start[894]: ALTER DATABASE gitlab # [ 8.909229] systemd[1]: Finished gitlab-config.service. gitlab # [ 8.911314] systemd[1]: Started gitaly.service. gitlab # [ 8.923453] postgresql-setup-start[901]: CREATE ROLE gitlab # [ 8.925047] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 8.927971] systemd[1]: Reached target PostgreSQL. gitlab # [ 8.928558] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 8.930218] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.011336] gitlab-postgresql-start[912]: CREATE DATABASE gitlab # [ 9.042153] gitlab-postgresql-start[917]: CREATE EXTENSION gitlab # [ 9.112180] gitlab-postgresql-start[924]: CREATE EXTENSION gitlab # [ 9.115825] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 9.326357] gitaly[900]: time="2026-10-25T13:06:39.865Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=900 gitlab # [ 9.327724] gitaly[900]: time="2026-10-25T13:06:39.865Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=900 gitlab # [ 9.328591] gitaly[900]: time="2026-10-25T13:06:39.865Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=900 gitlab # [ 9.329522] gitaly[900]: time="2026-10-25T13:06:39.866Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=900 gitlab # [ 9.330406] gitaly[900]: time="2026-10-25T13:06:39.866Z" level=info msg="Starting Gitaly" pid=900 version= gitlab # [ 9.492627] gitaly[900]: time="2026-10-25T13:06:40.032Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=155 pid=900 gitlab # [ 9.493786] gitaly[900]: time="2026-10-25T13:06:40.032Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=900 gitlab # [ 9.496368] gitaly[900]: time="2026-10-25T13:06:40.036Z" level=info msg="finished initializing command factory" duration_ms=3 pid=900 gitlab # [ 9.497083] gitaly[900]: time="2026-10-25T13:06:40.036Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-900/git-exec-3842026121.d/git pid=900 gitlab # [ 9.503857] gitaly[900]: time="2026-10-25T13:06:40.043Z" level=info msg="finished detecting git version" duration_ms=7 pid=900 gitlab # [ 9.504562] gitaly[900]: time="2026-10-25T13:06:40.043Z" level=info msg="using Git version" pid=900 version=2.53.g gitlab # [ 9.507268] gitaly[900]: time="2026-10-25T13:06:40.047Z" level=info msg="clearing disk cache object folder" pid=900 storage=default gitlab # [ 9.510573] gitaly[900]: time="2026-10-25T13:06:40.049Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2618847776 pid=900 storage=default gitlab # [ 9.511894] gitaly[900]: time="2026-10-25T13:06:40.049Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2618847776 pid=900 storage=default gitlab # [ 9.512683] gitaly[900]: time="2026-10-25T13:06:40.049Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=900 gitlab # [ 9.513934] gitaly[900]: time="2026-10-25T13:06:40.049Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=900 gitlab # [ 9.515033] gitaly[900]: time="2026-10-25T13:06:40.049Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2618847776 clear_duration_ms=0 pid=900 storage=default gitlab # [ 9.561281] gitaly[900]: time="2026-10-25T13:06:40.100Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=900 gitlab # [ 9.561963] gitaly[900]: time="2026-10-25T13:06:40.100Z" level=info msg="counting repositories" pid=900 gitlab # [ 9.562571] gitaly[900]: time="2026-10-25T13:06:40.101Z" level=info msg="finished tempdir cleaner walk" pid=900 storage=default time_ms=0 gitlab # [ 9.563069] gitaly[900]: time="2026-10-25T13:06:40.101Z" level=info msg="starting to count repositories" pid=900 storage_path=/var/gitlab/state/repositories gitlab # [ 9.563948] gitaly[900]: time="2026-10-25T13:06:40.101Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=900 schema=unix gitlab # [ 9.564492] gitaly[900]: time="2026-10-25T13:06:40.103Z" level=info msg="listening at address" address=/run/gitaly/gitaly-900/sock.d/intern pid=900 schema=unix gitlab # [ 9.571513] gitaly[900]: time="2026-10-25T13:06:40.111Z" level=info msg="completed counting repositories" counting_duration_ms=10 pid=900 storage_path=/var/gitlab/state/repositories gitlab # [ 9.572224] gitaly[900]: time="2026-10-25T13:06:40.111Z" level=info msg="completed counting all repositories" counting_duration=10 pid=900 gitlab # [ 9.572843] gitaly[900]: time="2026-10-25T13:06:40.111Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=900 gitlab # [ 9.573550] gitaly[900]: time="2026-10-25T13:06:40.111Z" level=info msg="Started Gitaly" duration_ms=245 pid=900 gitlab # [ 9.574152] gitaly[900]: time="2026-10-25T13:06:40.111Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=900 gitlab # [ 9.580676] gitaly[900]: time="2026-10-25T13:06:40.120Z" level=info msg="maintenance: daily scheduled" pid=900 scheduled="2026-10-26 12:00:00 +0000 UTC" gitlab # [ 9.600925] dhcpcd[770]: eth0: soliciting an IPv6 router gitlab # [ 9.601591] dhcpcd[770]: eth0: Router Advertisement from fe80::2 gitlab # [ 9.602427] dhcpcd[770]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 9.603099] dhcpcd[770]: eth0: adding route to fec0::/64 gitlab # [ 9.603668] dhcpcd[770]: eth0: adding default route via fe80::2 gitlab # [ 10.114500] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[911]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.116209] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[911]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.144228] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[911]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.532237] gitaly[900]: time="2026-10-25T13:06:42.071Z" level=info msg="License database preloaded" duration_ms=2205 pid=900 gitlab # [ 13.044851] dhcpcd[770]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.046417] dhcpcd[770]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.047814] dhcpcd[770]: eth0: adding default route via 10.0.2.2 gitlab # [ 13.156259] systemd[1]: Started DHCP Client. gitlab # [ 13.157066] systemd[1]: Reached target Network is Online. gitlab # [ 44.489975] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[911]: W, [2026-10-25T13:07:15.029401 #911] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 46.139904] postgres[1345]: [1345] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 46.141430] postgres[1345]: [1345] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 46.142827] postgres[1345]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 46.145186] postgres[1345]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 46.147154] postgres[1345]: attidentity AS identity, gitlab # [ 46.149099] postgres[1345]: attgenerated as attgenerated gitlab # [ 46.150968] postgres[1345]: FROM pg_attribute a gitlab # [ 46.152910] postgres[1345]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 46.155238] postgres[1345]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 46.157129] postgres[1345]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 46.158266] postgres[1345]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 46.160220] postgres[1345]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 46.162152] postgres[1345]: ORDER BY a.attnum gitlab # [ 46.164085] postgres[1345]: gitlab # [ 47.851129] gitlab-workhorse[825]: time="2026-10-25T13:07:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 49.734934] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1378]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 49.735994] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1378]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 57.851925] gitlab-workhorse[825]: time="2026-10-25T13:07:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 64.316893] postgres[1444]: [1444] ERROR: relation "table_without_models" does not exist gitlab # [ 64.318176] postgres[1444]: [1444] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 67.861893] gitlab-workhorse[825]: time="2026-10-25T13:07:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 77.395310] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 77.400532] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 77.402893] systemd[1]: Starting gitlab.service... gitlab # [ 77.762703] bundle[1629]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 77.763891] bundle[1629]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 77.764727] bundle[1629]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 77.863266] gitlab-workhorse[825]: time="2026-10-25T13:07:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 80.396976] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-10-25T13:07:50.919Z","message":"Starting cluster with 1 processes"} gitlab # [ 80.452757] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.972Z","pid":1629,"message":"* Enabling systemd notification integration"} gitlab # [ 80.454062] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.991Z","pid":1629,"message":"Puma starting in cluster mode..."} gitlab # [ 80.455252] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.991Z","pid":1629,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 80.456221] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.992Z","pid":1629,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 80.457192] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.992Z","pid":1629,"message":"* Min threads: 0"} gitlab # [ 80.458052] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.992Z","pid":1629,"message":"* Max threads: 4"} gitlab # [ 80.458968] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.992Z","pid":1629,"message":"* Environment: production"} gitlab # [ 80.460229] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.992Z","pid":1629,"message":"* Master PID: 1629"} gitlab # [ 80.461153] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.992Z","pid":1629,"message":"* Workers: 2"} gitlab # [ 80.462109] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.992Z","pid":1629,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 80.463048] bundle[1629]: {"timestamp":"2026-10-25T13:07:50.992Z","pid":1629,"message":"* Preloading application"} gitlab # [ 87.872617] gitlab-workhorse[825]: time="2026-10-25T13:07:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 97.873815] gitlab-workhorse[825]: time="2026-10-25T13:08:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 102.587518] bundle[1629]: W, [2026-10-25T13:08:13.126548 #1629] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 105.022719] sidekiq-cluster[1659]: 2026-10-25T13:08:15.561Z pid=1659 tid=wk3 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1659, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431976448} gitlab # [ 105.191579] sidekiq-cluster[1659]: W, [2026-10-25T13:08:15.731180 #1659] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 105.232133] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:15.771Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 107.053386] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.592Z","message":"GitLab reliable fetch activated!"} gitlab # [ 107.054669] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.592Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 107.078500] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.618Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 107.083067] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.622Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 107.087719] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.627Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 107.091988] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.631Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 107.096793] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.636Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 107.101272] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.641Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 107.105335] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.645Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 107.109290] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.649Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 107.113126] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.652Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 107.117097] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.656Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 107.121257] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.661Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 107.125792] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.665Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 107.129757] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.669Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 107.133829] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.673Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 107.138258] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.678Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 107.142700] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.682Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 107.147421] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.687Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 107.152177] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.691Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 107.157262] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.697Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 107.162936] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.702Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 107.169760] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.709Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 107.175236] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.714Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 107.180565] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.720Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 107.186240] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.725Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 107.192232] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.731Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 107.198286] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.738Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 107.204244] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.743Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 107.210286] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.750Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 107.216552] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.756Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 107.222755] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.762Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 107.228301] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.768Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 107.234641] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.774Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 107.240557] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.780Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 107.246902] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.786Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 107.252744] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.792Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 107.258357] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.798Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 107.264080] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.803Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 107.269248] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.808Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 107.274322] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.814Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 107.279285] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.819Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 107.285097] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.824Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 107.290290] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.830Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 107.316483] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.856Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 107.328602] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.868Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 107.338728] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.878Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 107.347530] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.887Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 107.356938] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.896Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 107.361889] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.901Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 107.367143] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.906Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 107.371070] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.910Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 107.374551] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.914Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 107.378835] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.918Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 107.388774] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.928Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 107.391103] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.930Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 107.393283] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.932Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 107.396653] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.936Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 107.398937] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.938Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 107.400729] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.940Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 107.402931] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.942Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 107.405193] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.944Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 107.408882] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.948Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 107.412172] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.951Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 107.416095] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.955Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 107.420036] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.959Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 107.423780] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.963Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 107.427681] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.967Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 107.430829] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:17.970Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 107.465967] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.005Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 107.469833] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.009Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 107.473669] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.013Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 107.479366] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.019Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 107.483053] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.022Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 107.487510] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.027Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 107.492019] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.031Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 107.497159] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.036Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 107.501702] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.041Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 107.506768] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.046Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 107.511433] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.051Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 107.516230] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.055Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 107.520424] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.060Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 107.525429] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.065Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 107.530315] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.070Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 107.536795] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.076Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 107.541282] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.081Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 107.547230] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.086Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 107.552046] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.091Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 107.558155] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.097Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 107.563237] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.102Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 107.569542] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.109Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 107.575245] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.114Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 107.579976] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.119Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 107.585188] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.124Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 107.589778] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.129Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 107.595839] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.135Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 107.601384] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.141Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 107.607863] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.147Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 107.612852] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.152Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 107.618621] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.158Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 107.632544] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.172Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 107.636351] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.176Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 107.639940] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.179Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 107.644671] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.184Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 107.648583] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.188Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 107.652794] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.192Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 107.656863] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.196Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 107.661087] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.200Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 107.664691] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.204Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 107.669702] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.209Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 107.673389] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:18.213Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 107.883679] gitlab-workhorse[825]: time="2026-10-25T13:08:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 117.892563] gitlab-workhorse[825]: time="2026-10-25T13:08:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 127.894396] gitlab-workhorse[825]: time="2026-10-25T13:08:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 129.595280] postgres[2097]: [2097] ERROR: relation "table_without_models" does not exist gitlab # [ 129.596072] postgres[2097]: [2097] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 129.895055] postgres[2108]: [2108] ERROR: relation "table_without_models" does not exist gitlab # [ 129.895744] postgres[2108]: [2108] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 132.083140] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:42.622Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 132.089492] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:42.629Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 132.090564] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:42.629Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 132.091712] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:42.629Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 132.103066] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:42.642Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 132.528418] bundle[1629]: {"timestamp":"2026-10-25T13:08:43.067Z","pid":1629,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 132.532655] bundle[1629]: {"timestamp":"2026-10-25T13:08:43.067Z","pid":1629,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 132.537353] bundle[1629]: {"timestamp":"2026-10-25T13:08:43.067Z","pid":1629,"message":"! #\u003cThread:0x00007a5371124938 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 132.548616] bundle[1629]: {"timestamp":"2026-10-25T13:08:43.067Z","pid":1629,"message":"! #\u003cThread:0x00007a53713383f0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 132.557670] bundle[1629]: {"timestamp":"2026-10-25T13:08:43.067Z","pid":1629,"message":"Use Ctrl-C to stop"} gitlab # [ 132.560104] bundle[1629]: {"timestamp":"2026-10-25T13:08:43.068Z","pid":1629,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 133.226261] bundle[1629]: {"timestamp":"2026-10-25T13:08:43.765Z","pid":1629,"message":"- Worker 0 (PID: 2175) booted in 0.67s, phase: 0"} gitlab # [ 133.249709] bundle[1629]: {"timestamp":"2026-10-25T13:08:43.789Z","pid":1629,"message":"- Worker 1 (PID: 2179) booted in 0.67s, phase: 0"} gitlab # [ 133.254068] systemd[1]: Started gitlab.service. gitlab # [ 133.255832] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 133.258351] systemd[1]: Starting setup-gitlab.service... gitlab # [ 133.273193] setup-gitlab-start[2203]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 133.398363] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:43.937Z","message":"Cleaning working queues"} gitlab # [ 133.401922] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:43.938Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"3d8c20fa9e9b28335868a9bb","created_at":"2026-10-25T13:07:47.605Z","trace_propagation_headers":{"sentry-trace":"e2a0ed66f70047198f03ac498e9801b5-c2e23314e9284e2c","baggage":"sentry-trace_id=e2a0ed66f70047198f03ac498e9801b5,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"67bda2ae622f66044cbf717eabc61f3e","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-25T13:07:47.619Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-3d8c20fa9e9b28335868a9bb: start","job_status":"start","queue_duration_s":56.318726,"scheduling_latency_s":56.318768} gitlab # [ 133.524326] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:08:44.063Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"3d8c20fa9e9b28335868a9bb","created_at":"2026-10-25T13:07:47.605Z","trace_propagation_headers":{"sentry-trace":"e2a0ed66f70047198f03ac498e9801b5-c2e23314e9284e2c","baggage":"sentry-trace_id=e2a0ed66f70047198f03ac498e9801b5,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"67bda2ae622f66044cbf717eabc61f3e","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-25T13:07:47.619Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-3d8c20fa9e9b28335868a9bb: done: 0.125331 sec","job_status":"done","queue_duration_s":56.318726,"scheduling_latency_s":56.318768,"redis_calls":26,"redis_duration_s":0.003755,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.001922,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.079563185,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.125331,"completed_at":"2026-10-25T13:08:44.063Z","load_balancing_strategy":"primary","db_duration_s":0.034468,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 135.114399] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:08:45 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 1821 gitlab # [ 135.116587] setup-gitlab-start[2203]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 135.117492] setup-gitlab-start[2203]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 135.141119] runuser[2228]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 135.502795] setup-gitlab-start[2229]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.507708] setup-gitlab-start[2229]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.512360] setup-gitlab-start[2229]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 136.066277] setup-gitlab-start[2229]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 136.071209] setup-gitlab-start[2229]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 136.075820] setup-gitlab-start[2229]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 151.371319] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:01.909Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"bc9defb16e9168b6f91e3a46","created_at":"2026-10-25T13:09:01.878Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d2209e332a1cbc8849642e0635311c3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:01.907Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-bc9defb16e9168b6f91e3a46: start","job_status":"start","queue_duration_s":0.001819,"scheduling_latency_s":0.001859} gitlab # [ 151.459726] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:01.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"bc9defb16e9168b6f91e3a46","created_at":"2026-10-25T13:09:01.878Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d2209e332a1cbc8849642e0635311c3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:01.907Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-bc9defb16e9168b6f91e3a46: done: 0.089594 sec","job_status":"done","queue_duration_s":0.001819,"scheduling_latency_s":0.001859,"redis_calls":12,"redis_duration_s":0.007154000000000001,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001119,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001603,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001041194,"exclusive_lock_hold_duration_s":0.017458084999999998,"duration_s":0.089594,"completed_at":"2026-10-25T13:09:01.998Z","load_balancing_strategy":"primary","db_duration_s":0.012575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.522137] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.061Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"946ae6ee109480893c147a54","created_at":"2026-10-25T13:09:01.945Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bfdfdf4eeff08237b278b05b0887c50","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:01.962Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-946ae6ee109480893c147a54: start","job_status":"start","queue_duration_s":0.098382,"scheduling_latency_s":0.098424} gitlab # [ 151.610871] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.150Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"946ae6ee109480893c147a54","created_at":"2026-10-25T13:09:01.945Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bfdfdf4eeff08237b278b05b0887c50","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:01.962Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-946ae6ee109480893c147a54: done: 0.088678 sec","job_status":"done","queue_duration_s":0.098382,"scheduling_latency_s":0.098424,"redis_calls":13,"redis_duration_s":0.00997,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000896,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.006852,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002222,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.018019609,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.088678,"completed_at":"2026-10-25T13:09:02.149Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0134,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 151.655092] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ac92c2c83e4802b3c03f2ee5","created_at":"2026-10-25T13:09:01.978Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b6aac50ddbe0c95ce5688ec47eeca69","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.091Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ac92c2c83e4802b3c03f2ee5: start","job_status":"start","queue_duration_s":0.063595,"scheduling_latency_s":0.063629} gitlab # [ 151.655759] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.182Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ac92c2c83e4802b3c03f2ee5","created_at":"2026-10-25T13:09:01.978Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b6aac50ddbe0c95ce5688ec47eeca69","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.091Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ac92c2c83e4802b3c03f2ee5: done: 0.027602 sec","job_status":"done","queue_duration_s":0.063595,"scheduling_latency_s":0.063629,"redis_calls":12,"redis_duration_s":0.003533,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001231,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000454527,"duration_s":0.027602,"completed_at":"2026-10-25T13:09:02.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001112,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.694145] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1b674c417524e766bbff22cd","created_at":"2026-10-25T13:09:02.114Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d116bc0ab8ed417c3ff03077b9f903e3","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.124Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1b674c417524e766bbff22cd: start","job_status":"start","queue_duration_s":0.059567,"scheduling_latency_s":0.059591} gitlab # [ 152.187411] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.726Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1b674c417524e766bbff22cd","created_at":"2026-10-25T13:09:02.114Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d116bc0ab8ed417c3ff03077b9f903e3","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.124Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1b674c417524e766bbff22cd: done: 0.542443 sec","job_status":"done","queue_duration_s":0.059567,"scheduling_latency_s":0.059591,"redis_calls":565,"redis_duration_s":0.30677899999999997,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000382,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.305457,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.263867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205054,"duration_s":0.542443,"completed_at":"2026-10-25T13:09:02.726Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.223997] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.763Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"0cd89c0b0dea2d81d1cffdfd","created_at":"2026-10-25T13:09:02.146Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1e812aba8ea7317442c6932ce7bd633","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.276Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-0cd89c0b0dea2d81d1cffdfd: start","job_status":"start","queue_duration_s":0.487513,"scheduling_latency_s":0.487534} gitlab # [ 152.248394] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.788Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 152.260588] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"0cd89c0b0dea2d81d1cffdfd","created_at":"2026-10-25T13:09:02.146Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1e812aba8ea7317442c6932ce7bd633","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.276Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-0cd89c0b0dea2d81d1cffdfd: done: 0.036259 sec","job_status":"done","queue_duration_s":0.487513,"scheduling_latency_s":0.487534,"redis_calls":10,"redis_duration_s":0.0041589999999999995,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000463,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000410108,"duration_s":0.036259,"completed_at":"2026-10-25T13:09:02.799Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000715,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.298854] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9c24f09968fadf8455545601","created_at":"2026-10-25T13:09:02.284Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64a792876498c81826411a5945e0c1bf","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.290Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9c24f09968fadf8455545601: start","job_status":"start","queue_duration_s":0.548179,"scheduling_latency_s":0.548216} gitlab # [ 152.352665] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9c24f09968fadf8455545601","created_at":"2026-10-25T13:09:02.284Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64a792876498c81826411a5945e0c1bf","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.290Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9c24f09968fadf8455545601: done: 0.053551 sec","job_status":"done","queue_duration_s":0.548179,"scheduling_latency_s":0.548216,"redis_calls":10,"redis_duration_s":0.002147,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000446,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000433854,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.053551,"completed_at":"2026-10-25T13:09:02.891Z","load_balancing_strategy":"primary","db_duration_s":0.013959,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.392315] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:02.931Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"56070b7776166f3e0b63b31e","created_at":"2026-10-25T13:09:02.298Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f9557362f70a54b1f0ee1dc4a554323","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.302Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-56070b7776166f3e0b63b31e: start","job_status":"start","queue_duration_s":0.628234,"scheduling_latency_s":0.628256} gitlab # [ 152.625139] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"56070b7776166f3e0b63b31e","created_at":"2026-10-25T13:09:02.298Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f9557362f70a54b1f0ee1dc4a554323","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.302Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-56070b7776166f3e0b63b31e: done: 0.233117 sec","job_status":"done","queue_duration_s":0.628234,"scheduling_latency_s":0.628256,"redis_calls":14,"redis_duration_s":0.00384,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001225,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.039,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000741155,"exclusive_lock_hold_duration_s":0.204959847,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.233117,"completed_at":"2026-10-25T13:09:03.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058757,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.664332] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"815749baf909c870635ff36f","created_at":"2026-10-25T13:09:02.321Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cfa37b7c5aba16541ececc414a0dc7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-25T13:09:02.326Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-815749baf909c870635ff36f: start","job_status":"start","queue_duration_s":0.877382,"scheduling_latency_s":0.877407} gitlab # [ 152.692898] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.232Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 152.704256] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.243Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"815749baf909c870635ff36f","created_at":"2026-10-25T13:09:02.321Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cfa37b7c5aba16541ececc414a0dc7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-25T13:09:02.326Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-815749baf909c870635ff36f: done: 0.039639 sec","job_status":"done","queue_duration_s":0.877382,"scheduling_latency_s":0.877407,"redis_calls":10,"redis_duration_s":0.0029560000000000003,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000617,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000586,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000534426,"duration_s":0.039639,"completed_at":"2026-10-25T13:09:03.243Z","load_balancing_strategy":"primary","db_duration_s":0.000717,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.741819] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.280Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"220bb1559ec69eeb3e6e465c","created_at":"2026-10-25T13:09:02.378Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ceb2762c35db4a97860b47f70d8ef1a0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-25T13:09:02.388Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-220bb1559ec69eeb3e6e465c: start","job_status":"start","queue_duration_s":0.892018,"scheduling_latency_s":0.892105} gitlab # [ 152.782905] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.321Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"220bb1559ec69eeb3e6e465c","created_at":"2026-10-25T13:09:02.378Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ceb2762c35db4a97860b47f70d8ef1a0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-25T13:09:02.388Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-220bb1559ec69eeb3e6e465c: done: 0.041148 sec","job_status":"done","queue_duration_s":0.892018,"scheduling_latency_s":0.892105,"redis_calls":10,"redis_duration_s":0.002297,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000431,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00139,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000553701,"duration_s":0.041148,"completed_at":"2026-10-25T13:09:03.321Z","load_balancing_strategy":"primary","db_duration_s":0.005577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.819684] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"da049feecade5b7709d8824f","created_at":"2026-10-25T13:09:02.401Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.410Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-da049feecade5b7709d8824f: start","job_status":"start","queue_duration_s":0.948085,"scheduling_latency_s":0.948117} gitlab # [ 152.962404] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.501Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"da049feecade5b7709d8824f","created_at":"2026-10-25T13:09:02.401Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.410Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-da049feecade5b7709d8824f: done: 0.142506 sec","job_status":"done","queue_duration_s":0.948085,"scheduling_latency_s":0.948117,"redis_calls":71,"redis_duration_s":0.01859,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002044,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000994,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014865,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000687,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000458159,"duration_s":0.142506,"completed_at":"2026-10-25T13:09:03.501Z","load_balancing_strategy":"primary","db_duration_s":0.002576,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.000716] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.503Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"212961356da98f0e0c1265d2","created_at":"2026-10-25T13:09:02.417Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7cf5f147eba068e46e161efb0d934fd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.431Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-212961356da98f0e0c1265d2: start","job_status":"start","queue_duration_s":1.0714,"scheduling_latency_s":1.071415} gitlab # [ 153.013737] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.513Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 153.017043] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"212961356da98f0e0c1265d2","created_at":"2026-10-25T13:09:02.417Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7cf5f147eba068e46e161efb0d934fd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.431Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-212961356da98f0e0c1265d2: done: 0.020858 sec","job_status":"done","queue_duration_s":1.0714,"scheduling_latency_s":1.071415,"redis_calls":10,"redis_duration_s":0.002371,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000785295,"duration_s":0.020858,"completed_at":"2026-10-25T13:09:03.523Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.055127] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.525Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"271f031a7f8191bfc0223872","created_at":"2026-10-25T13:09:02.441Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55fa4721d8d550c8a0744d15228458ef","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.450Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-271f031a7f8191bfc0223872: start","job_status":"start","queue_duration_s":1.075352,"scheduling_latency_s":1.075383} gitlab # [ 153.067660] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"271f031a7f8191bfc0223872","created_at":"2026-10-25T13:09:02.441Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55fa4721d8d550c8a0744d15228458ef","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.450Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-271f031a7f8191bfc0223872: done: 0.029447 sec","job_status":"done","queue_duration_s":1.075352,"scheduling_latency_s":1.075383,"redis_calls":10,"redis_duration_s":0.0027419999999999996,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000525206,"duration_s":0.029447,"completed_at":"2026-10-25T13:09:03.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.104660] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"33a008ba9032a26db0513667","created_at":"2026-10-25T13:09:02.459Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8063637a67224cebe1994f50752fab4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.468Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-33a008ba9032a26db0513667: start","job_status":"start","queue_duration_s":1.088668,"scheduling_latency_s":1.088693} gitlab # [ 153.105407] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"33a008ba9032a26db0513667","created_at":"2026-10-25T13:09:02.459Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8063637a67224cebe1994f50752fab4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.468Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-33a008ba9032a26db0513667: done: 0.043941 sec","job_status":"done","queue_duration_s":1.088668,"scheduling_latency_s":1.088693,"redis_calls":12,"redis_duration_s":0.002441,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000833,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000442235,"exclusive_lock_hold_duration_s":0.019835481999999998,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.043941,"completed_at":"2026-10-25T13:09:03.600Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010352,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.117743] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.602Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ac6b0706426e382312d1bfe6","created_at":"2026-10-25T13:09:02.490Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"267c772bc0a07d4bcd77b55ca80b157a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.497Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ac6b0706426e382312d1bfe6: start","job_status":"start","queue_duration_s":1.104748,"scheduling_latency_s":1.104763} gitlab # [ 153.130722] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.609Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 153.133714] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ac6b0706426e382312d1bfe6","created_at":"2026-10-25T13:09:02.490Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"267c772bc0a07d4bcd77b55ca80b157a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.497Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ac6b0706426e382312d1bfe6: done: 0.011277 sec","job_status":"done","queue_duration_s":1.104748,"scheduling_latency_s":1.104763,"redis_calls":10,"redis_duration_s":0.001268,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212597,"duration_s":0.011277,"completed_at":"2026-10-25T13:09:03.613Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.197388] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"cec26cb619098c3fd92a2fe7","created_at":"2026-10-25T13:09:02.506Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42365cf0aea8504ea296e7e5b410a25e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.513Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-cec26cb619098c3fd92a2fe7: start","job_status":"start","queue_duration_s":1.100816,"scheduling_latency_s":1.10083} gitlab # [ 153.198064] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"cec26cb619098c3fd92a2fe7","created_at":"2026-10-25T13:09:02.506Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42365cf0aea8504ea296e7e5b410a25e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.513Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-cec26cb619098c3fd92a2fe7: done: 0.019797 sec","job_status":"done","queue_duration_s":1.100816,"scheduling_latency_s":1.10083,"redis_calls":19,"redis_duration_s":0.0022329999999999997,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00051,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000203,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001161,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000359,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191085,"duration_s":0.019797,"completed_at":"2026-10-25T13:09:03.633Z","load_balancing_strategy":"primary","db_duration_s":0.001121,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.241775] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"10014d56b7821fc264ba36e4","created_at":"2026-10-25T13:09:02.521Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d158f349471c9d4c421383c64bf00af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.528Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-10014d56b7821fc264ba36e4: start","job_status":"start","queue_duration_s":1.106016,"scheduling_latency_s":1.10603} gitlab # [ 153.242544] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.641Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 153.243071] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"10014d56b7821fc264ba36e4","created_at":"2026-10-25T13:09:02.521Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d158f349471c9d4c421383c64bf00af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.528Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-10014d56b7821fc264ba36e4: done: 0.010768 sec","job_status":"done","queue_duration_s":1.106016,"scheduling_latency_s":1.10603,"redis_calls":10,"redis_duration_s":0.001174,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000226,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223212,"duration_s":0.010768,"completed_at":"2026-10-25T13:09:03.645Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.302779] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.646Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b066dd0d64a7f1df6c43f2a5","created_at":"2026-10-25T13:09:02.537Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8f1134fea3e2039f14914ec906efacc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.557Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b066dd0d64a7f1df6c43f2a5: start","job_status":"start","queue_duration_s":1.089096,"scheduling_latency_s":1.089109} gitlab # [ 153.303837] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b066dd0d64a7f1df6c43f2a5","created_at":"2026-10-25T13:09:02.537Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8f1134fea3e2039f14914ec906efacc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.557Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b066dd0d64a7f1df6c43f2a5: done: 0.023283 sec","job_status":"done","queue_duration_s":1.089096,"scheduling_latency_s":1.089109,"redis_calls":12,"redis_duration_s":0.001598,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000338031,"exclusive_lock_hold_duration_s":0.010504967,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.023283,"completed_at":"2026-10-25T13:09:03.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.326743] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3b97533e9ed0ed141bfa8dcb","created_at":"2026-10-25T13:09:02.568Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f52ae44099a1ec37c88a7f68a2352b1","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.575Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3b97533e9ed0ed141bfa8dcb: start","job_status":"start","queue_duration_s":1.094822,"scheduling_latency_s":1.094835} gitlab # [ 153.366873] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3b97533e9ed0ed141bfa8dcb","created_at":"2026-10-25T13:09:02.568Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f52ae44099a1ec37c88a7f68a2352b1","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.575Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3b97533e9ed0ed141bfa8dcb: done: 0.014209 sec","job_status":"done","queue_duration_s":1.094822,"scheduling_latency_s":1.094835,"redis_calls":12,"redis_duration_s":0.0016769999999999999,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000642,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000389714,"exclusive_lock_hold_duration_s":0.001984051,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.014209,"completed_at":"2026-10-25T13:09:03.684Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.378067] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"321c7faca992d18966403f6e","created_at":"2026-10-25T13:09:02.588Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3d74476697c68688c2ed93b3debbace","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.595Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-321c7faca992d18966403f6e: start","job_status":"start","queue_duration_s":1.090483,"scheduling_latency_s":1.090497} gitlab # [ 153.391522] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"321c7faca992d18966403f6e","created_at":"2026-10-25T13:09:02.588Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3d74476697c68688c2ed93b3debbace","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.595Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-321c7faca992d18966403f6e: done: 0.012621 sec","job_status":"done","queue_duration_s":1.090483,"scheduling_latency_s":1.090497,"redis_calls":10,"redis_duration_s":0.00157,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217346,"duration_s":0.012621,"completed_at":"2026-10-25T13:09:03.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000878,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.439467] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"17655366be14eac04e36546d","created_at":"2026-10-25T13:09:02.602Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17880ef55eb11e7b538d075d61ebd013","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.608Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-17655366be14eac04e36546d: start","job_status":"start","queue_duration_s":1.090505,"scheduling_latency_s":1.090518} gitlab # [ 153.440714] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.719Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"17655366be14eac04e36546d","created_at":"2026-10-25T13:09:02.602Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17880ef55eb11e7b538d075d61ebd013","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:02.608Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-17655366be14eac04e36546d: done: 0.019798 sec","job_status":"done","queue_duration_s":1.090505,"scheduling_latency_s":1.090518,"redis_calls":16,"redis_duration_s":0.0020529999999999997,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001017,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213155,"duration_s":0.019798,"completed_at":"2026-10-25T13:09:03.719Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002759,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.510701] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"1e17f32861521e2a9325a905","created_at":"2026-10-25T13:09:02.622Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb2f5f99715295f5d70a235801a84102","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-25T13:09:02.629Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-1e17f32861521e2a9325a905: start","job_status":"start","queue_duration_s":1.090793,"scheduling_latency_s":1.090806} gitlab # [ 153.511475] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.727Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 153.512230] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"1e17f32861521e2a9325a905","created_at":"2026-10-25T13:09:02.622Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-d22ce8117b0d4a79","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb2f5f99715295f5d70a235801a84102","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-25T13:09:02.629Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-1e17f32861521e2a9325a905: done: 0.011917 sec","job_status":"done","queue_duration_s":1.090793,"scheduling_latency_s":1.090806,"redis_calls":10,"redis_duration_s":0.001241,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208406,"duration_s":0.011917,"completed_at":"2026-10-25T13:09:03.732Z","load_balancing_strategy":"primary","db_duration_s":0.000399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.562573] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"604924e0fe38df112a9b727a","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-604924e0fe38df112a9b727a: start","job_status":"start","queue_duration_s":0.243341,"scheduling_latency_s":0.243354} gitlab # [ 153.563408] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"604924e0fe38df112a9b727a","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-604924e0fe38df112a9b727a: done: 0.014821 sec","job_status":"done","queue_duration_s":0.243341,"scheduling_latency_s":0.243354,"redis_calls":16,"redis_duration_s":0.0021,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208406,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014821,"completed_at":"2026-10-25T13:09:03.747Z","load_balancing_strategy":"primary","db_duration_s":0.000745,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.614651] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9714439a65a49e10067d1963","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9714439a65a49e10067d1963: start","job_status":"start","queue_duration_s":0.259198,"scheduling_latency_s":0.259212} gitlab # [ 153.615264] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9714439a65a49e10067d1963","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9714439a65a49e10067d1963: done: 0.009776 sec","job_status":"done","queue_duration_s":0.259198,"scheduling_latency_s":0.259212,"redis_calls":13,"redis_duration_s":0.001585,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009776,"completed_at":"2026-10-25T13:09:03.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.661289] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cee04fb71aa56e2bbf92cd3e","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cee04fb71aa56e2bbf92cd3e: start","job_status":"start","queue_duration_s":0.269951,"scheduling_latency_s":0.269964} gitlab # [ 153.662049] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cee04fb71aa56e2bbf92cd3e","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cee04fb71aa56e2bbf92cd3e: done: 0.009589 sec","job_status":"done","queue_duration_s":0.269951,"scheduling_latency_s":0.269964,"redis_calls":13,"redis_duration_s":0.001587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009589,"completed_at":"2026-10-25T13:09:03.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.669712] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a599e77702f004b8a99ae75","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a599e77702f004b8a99ae75: start","job_status":"start","queue_duration_s":0.28053,"scheduling_latency_s":0.280544} gitlab # [ 153.708289] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a599e77702f004b8a99ae75","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a599e77702f004b8a99ae75: done: 0.009538 sec","job_status":"done","queue_duration_s":0.28053,"scheduling_latency_s":0.280544,"redis_calls":13,"redis_duration_s":0.001564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009538,"completed_at":"2026-10-25T13:09:03.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.748220] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37a2977f0b84bb2d56d1afac","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37a2977f0b84bb2d56d1afac: start","job_status":"start","queue_duration_s":0.29108,"scheduling_latency_s":0.291095} gitlab # [ 153.748943] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37a2977f0b84bb2d56d1afac","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37a2977f0b84bb2d56d1afac: done: 0.009519 sec","job_status":"done","queue_duration_s":0.29108,"scheduling_latency_s":0.291095,"redis_calls":13,"redis_duration_s":0.0015400000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009519,"completed_at":"2026-10-25T13:09:03.790Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.789721] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00509e8f76ab5af208745788","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00509e8f76ab5af208745788: start","job_status":"start","queue_duration_s":0.30146,"scheduling_latency_s":0.301473} gitlab # [ 153.790738] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00509e8f76ab5af208745788","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00509e8f76ab5af208745788: done: 0.01028 sec","job_status":"done","queue_duration_s":0.30146,"scheduling_latency_s":0.301473,"redis_calls":13,"redis_duration_s":0.002162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01028,"completed_at":"2026-10-25T13:09:03.801Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.808088] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0ace62afcb6f5032f2c46fe","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0ace62afcb6f5032f2c46fe: start","job_status":"start","queue_duration_s":0.312605,"scheduling_latency_s":0.312619} gitlab # [ 153.819774] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0ace62afcb6f5032f2c46fe","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0ace62afcb6f5032f2c46fe: done: 0.00973 sec","job_status":"done","queue_duration_s":0.312605,"scheduling_latency_s":0.312619,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00973,"completed_at":"2026-10-25T13:09:03.812Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.872041] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fdf7440352d9103413299f8","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fdf7440352d9103413299f8: start","job_status":"start","queue_duration_s":0.323203,"scheduling_latency_s":0.323217} gitlab # [ 153.872725] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fdf7440352d9103413299f8","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fdf7440352d9103413299f8: done: 0.009717 sec","job_status":"done","queue_duration_s":0.323203,"scheduling_latency_s":0.323217,"redis_calls":13,"redis_duration_s":0.0016060000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009717,"completed_at":"2026-10-25T13:09:03.822Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.925758] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c74dbddcdf7d8ba10d793377","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c74dbddcdf7d8ba10d793377: start","job_status":"start","queue_duration_s":0.333723,"scheduling_latency_s":0.333736} gitlab # [ 153.926533] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c74dbddcdf7d8ba10d793377","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c74dbddcdf7d8ba10d793377: done: 0.009844 sec","job_status":"done","queue_duration_s":0.333723,"scheduling_latency_s":0.333736,"redis_calls":13,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009844,"completed_at":"2026-10-25T13:09:03.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.969680] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14817e41eb00fd1081cfa07f","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14817e41eb00fd1081cfa07f: start","job_status":"start","queue_duration_s":0.344407,"scheduling_latency_s":0.34442} gitlab # [ 153.970501] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14817e41eb00fd1081cfa07f","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14817e41eb00fd1081cfa07f: done: 0.009906 sec","job_status":"done","queue_duration_s":0.344407,"scheduling_latency_s":0.34442,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009906,"completed_at":"2026-10-25T13:09:03.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.991236] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d10bb4d2f98e0032c4b9734","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d10bb4d2f98e0032c4b9734: start","job_status":"start","queue_duration_s":0.355126,"scheduling_latency_s":0.355138} gitlab # [ 154.031905] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d10bb4d2f98e0032c4b9734","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d10bb4d2f98e0032c4b9734: done: 0.0096 sec","job_status":"done","queue_duration_s":0.355126,"scheduling_latency_s":0.355138,"redis_calls":13,"redis_duration_s":0.001587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0096,"completed_at":"2026-10-25T13:09:03.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.036519] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4469d38c716e6e49d6d5663e","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4469d38c716e6e49d6d5663e: start","job_status":"start","queue_duration_s":0.365719,"scheduling_latency_s":0.365732} gitlab # [ 154.047742] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4469d38c716e6e49d6d5663e","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4469d38c716e6e49d6d5663e: done: 0.009737 sec","job_status":"done","queue_duration_s":0.365719,"scheduling_latency_s":0.365732,"redis_calls":13,"redis_duration_s":0.001607,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009737,"completed_at":"2026-10-25T13:09:03.865Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.087219] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdf1cdd288854c63333b90d8","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdf1cdd288854c63333b90d8: start","job_status":"start","queue_duration_s":0.376458,"scheduling_latency_s":0.376471} gitlab # [ 154.093212] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdf1cdd288854c63333b90d8","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdf1cdd288854c63333b90d8: done: 0.00959 sec","job_status":"done","queue_duration_s":0.376458,"scheduling_latency_s":0.376471,"redis_calls":13,"redis_duration_s":0.00158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00959,"completed_at":"2026-10-25T13:09:03.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.136689] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37d292bf53b1651cef1c2bf7","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37d292bf53b1651cef1c2bf7: start","job_status":"start","queue_duration_s":0.387024,"scheduling_latency_s":0.387037} gitlab # [ 154.137428] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37d292bf53b1651cef1c2bf7","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37d292bf53b1651cef1c2bf7: done: 0.009587 sec","job_status":"done","queue_duration_s":0.387024,"scheduling_latency_s":0.387037,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009587,"completed_at":"2026-10-25T13:09:03.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.179161] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bfdc87b4523a7f47dcfc7bf","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bfdc87b4523a7f47dcfc7bf: start","job_status":"start","queue_duration_s":0.397587,"scheduling_latency_s":0.397601} gitlab # [ 154.180980] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bfdc87b4523a7f47dcfc7bf","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bfdc87b4523a7f47dcfc7bf: done: 0.01059 sec","job_status":"done","queue_duration_s":0.397587,"scheduling_latency_s":0.397601,"redis_calls":13,"redis_duration_s":0.002578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001843,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01059,"completed_at":"2026-10-25T13:09:03.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.228808] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af7c96a7328bf0a8e3ebe31e","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af7c96a7328bf0a8e3ebe31e: start","job_status":"start","queue_duration_s":0.40937,"scheduling_latency_s":0.409384} gitlab # [ 154.229609] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af7c96a7328bf0a8e3ebe31e","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af7c96a7328bf0a8e3ebe31e: done: 0.010211 sec","job_status":"done","queue_duration_s":0.40937,"scheduling_latency_s":0.409384,"redis_calls":13,"redis_duration_s":0.0023959999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001545,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010211,"completed_at":"2026-10-25T13:09:03.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.267552] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcc28fa0d5e648581c7f9123","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcc28fa0d5e648581c7f9123: start","job_status":"start","queue_duration_s":0.420418,"scheduling_latency_s":0.42043} gitlab # [ 154.268914] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcc28fa0d5e648581c7f9123","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcc28fa0d5e648581c7f9123: done: 0.009825 sec","job_status":"done","queue_duration_s":0.420418,"scheduling_latency_s":0.42043,"redis_calls":13,"redis_duration_s":0.0016589999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009825,"completed_at":"2026-10-25T13:09:03.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.307188] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc276709324d51c10ca3c222","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc276709324d51c10ca3c222: start","job_status":"start","queue_duration_s":0.43106,"scheduling_latency_s":0.431073} gitlab # [ 154.344775] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc276709324d51c10ca3c222","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc276709324d51c10ca3c222: done: 0.009628 sec","job_status":"done","queue_duration_s":0.43106,"scheduling_latency_s":0.431073,"redis_calls":13,"redis_duration_s":0.0017200000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009628,"completed_at":"2026-10-25T13:09:03.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.346500] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83b71c00e469e630e8a99862","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83b71c00e469e630e8a99862: start","job_status":"start","queue_duration_s":0.441536,"scheduling_latency_s":0.44155} gitlab # [ 154.387299] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83b71c00e469e630e8a99862","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83b71c00e469e630e8a99862: done: 0.00965 sec","job_status":"done","queue_duration_s":0.441536,"scheduling_latency_s":0.44155,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00965,"completed_at":"2026-10-25T13:09:03.940Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.390955] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b395ad4f9e4e023dce5f077","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b395ad4f9e4e023dce5f077: start","job_status":"start","queue_duration_s":0.452012,"scheduling_latency_s":0.452025} gitlab # [ 154.402534] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b395ad4f9e4e023dce5f077","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b395ad4f9e4e023dce5f077: done: 0.014264 sec","job_status":"done","queue_duration_s":0.452012,"scheduling_latency_s":0.452025,"redis_calls":13,"redis_duration_s":0.006037,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014264,"completed_at":"2026-10-25T13:09:03.955Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.446902] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9ec5c191d26ec8796d6e821","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9ec5c191d26ec8796d6e821: start","job_status":"start","queue_duration_s":0.467267,"scheduling_latency_s":0.467281} gitlab # [ 154.447783] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9ec5c191d26ec8796d6e821","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9ec5c191d26ec8796d6e821: done: 0.009555 sec","job_status":"done","queue_duration_s":0.467267,"scheduling_latency_s":0.467281,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009555,"completed_at":"2026-10-25T13:09:03.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.503722] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6e770f11e440b372afdfb9d","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6e770f11e440b372afdfb9d: start","job_status":"start","queue_duration_s":0.477813,"scheduling_latency_s":0.477827} gitlab # [ 154.504615] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6e770f11e440b372afdfb9d","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6e770f11e440b372afdfb9d: done: 0.009467 sec","job_status":"done","queue_duration_s":0.477813,"scheduling_latency_s":0.477827,"redis_calls":13,"redis_duration_s":0.0017100000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000664,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009467,"completed_at":"2026-10-25T13:09:03.976Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.557523] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72a7648b9b452b57d985835f","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72a7648b9b452b57d985835f: start","job_status":"start","queue_duration_s":0.48809,"scheduling_latency_s":0.488103} gitlab # [ 154.558309] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72a7648b9b452b57d985835f","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72a7648b9b452b57d985835f: done: 0.009612 sec","job_status":"done","queue_duration_s":0.48809,"scheduling_latency_s":0.488103,"redis_calls":13,"redis_duration_s":0.0015789999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009612,"completed_at":"2026-10-25T13:09:03.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.571492] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcf6f754222cecaee3bc73eb","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcf6f754222cecaee3bc73eb: start","job_status":"start","queue_duration_s":0.49853,"scheduling_latency_s":0.498543} gitlab # [ 154.582741] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcf6f754222cecaee3bc73eb","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcf6f754222cecaee3bc73eb: done: 0.00977 sec","job_status":"done","queue_duration_s":0.49853,"scheduling_latency_s":0.498543,"redis_calls":13,"redis_duration_s":0.001803,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00977,"completed_at":"2026-10-25T13:09:03.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.632045] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:03.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7b30fe48af7311f34488aae","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7b30fe48af7311f34488aae: start","job_status":"start","queue_duration_s":0.509103,"scheduling_latency_s":0.509116} gitlab # [ 154.632743] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7b30fe48af7311f34488aae","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7b30fe48af7311f34488aae: done: 0.009721 sec","job_status":"done","queue_duration_s":0.509103,"scheduling_latency_s":0.509116,"redis_calls":13,"redis_duration_s":0.001954,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009721,"completed_at":"2026-10-25T13:09:04.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.680784] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f43fa22c423afc93c54605fd","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f43fa22c423afc93c54605fd: start","job_status":"start","queue_duration_s":0.519699,"scheduling_latency_s":0.519713} gitlab # [ 154.681896] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f43fa22c423afc93c54605fd","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f43fa22c423afc93c54605fd: done: 0.009649 sec","job_status":"done","queue_duration_s":0.519699,"scheduling_latency_s":0.519713,"redis_calls":13,"redis_duration_s":0.001534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009649,"completed_at":"2026-10-25T13:09:04.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.746320] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53aab76cc5efa8757d94433f","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53aab76cc5efa8757d94433f: start","job_status":"start","queue_duration_s":0.530161,"scheduling_latency_s":0.530199} gitlab # [ 154.747267] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53aab76cc5efa8757d94433f","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53aab76cc5efa8757d94433f: done: 0.009433 sec","job_status":"done","queue_duration_s":0.530161,"scheduling_latency_s":0.530199,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009433,"completed_at":"2026-10-25T13:09:04.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.756961] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62774eab8480c72a6211e0ed","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62774eab8480c72a6211e0ed: start","job_status":"start","queue_duration_s":0.540586,"scheduling_latency_s":0.540599} gitlab # [ 154.800323] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62774eab8480c72a6211e0ed","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62774eab8480c72a6211e0ed: done: 0.009532 sec","job_status":"done","queue_duration_s":0.540586,"scheduling_latency_s":0.540599,"redis_calls":13,"redis_duration_s":0.0015890000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009532,"completed_at":"2026-10-25T13:09:04.039Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.804597] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"427dbf09116be1d7a8fd24e3","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-427dbf09116be1d7a8fd24e3: start","job_status":"start","queue_duration_s":0.551106,"scheduling_latency_s":0.55112} gitlab # [ 154.844855] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"427dbf09116be1d7a8fd24e3","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-427dbf09116be1d7a8fd24e3: done: 0.009574 sec","job_status":"done","queue_duration_s":0.551106,"scheduling_latency_s":0.55112,"redis_calls":13,"redis_duration_s":0.0015480000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009574,"completed_at":"2026-10-25T13:09:04.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.850542] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1574bd7fbcb9ebf75edc2762","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1574bd7fbcb9ebf75edc2762: start","job_status":"start","queue_duration_s":0.561675,"scheduling_latency_s":0.561688} gitlab # [ 154.898771] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1574bd7fbcb9ebf75edc2762","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1574bd7fbcb9ebf75edc2762: done: 0.009633 sec","job_status":"done","queue_duration_s":0.561675,"scheduling_latency_s":0.561688,"redis_calls":13,"redis_duration_s":0.00174,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009633,"completed_at":"2026-10-25T13:09:04.060Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.899984] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d674a2973683396b51f482c9","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d674a2973683396b51f482c9: start","job_status":"start","queue_duration_s":0.572286,"scheduling_latency_s":0.572299} gitlab # [ 154.909632] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d674a2973683396b51f482c9","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d674a2973683396b51f482c9: done: 0.00959 sec","job_status":"done","queue_duration_s":0.572286,"scheduling_latency_s":0.572299,"redis_calls":13,"redis_duration_s":0.001654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00959,"completed_at":"2026-10-25T13:09:04.071Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.949689] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b51cf3b5a05dd84d30845efb","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b51cf3b5a05dd84d30845efb: start","job_status":"start","queue_duration_s":0.582856,"scheduling_latency_s":0.58287} gitlab # [ 154.989899] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b51cf3b5a05dd84d30845efb","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b51cf3b5a05dd84d30845efb: done: 0.009525 sec","job_status":"done","queue_duration_s":0.582856,"scheduling_latency_s":0.58287,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009525,"completed_at":"2026-10-25T13:09:04.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.029637] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3276f80306bca655a602b811","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3276f80306bca655a602b811: start","job_status":"start","queue_duration_s":0.593346,"scheduling_latency_s":0.59336} gitlab # [ 155.030473] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3276f80306bca655a602b811","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3276f80306bca655a602b811: done: 0.009493 sec","job_status":"done","queue_duration_s":0.593346,"scheduling_latency_s":0.59336,"redis_calls":13,"redis_duration_s":0.001567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009493,"completed_at":"2026-10-25T13:09:04.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.038471] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db763d2205e2d77e7a261599","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db763d2205e2d77e7a261599: start","job_status":"start","queue_duration_s":0.603665,"scheduling_latency_s":0.603678} gitlab # [ 155.049832] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db763d2205e2d77e7a261599","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db763d2205e2d77e7a261599: done: 0.009902 sec","job_status":"done","queue_duration_s":0.603665,"scheduling_latency_s":0.603678,"redis_calls":13,"redis_duration_s":0.0017569999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009902,"completed_at":"2026-10-25T13:09:04.103Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.101118] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"442b57a327ef98366211e1d4","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-442b57a327ef98366211e1d4: start","job_status":"start","queue_duration_s":0.614451,"scheduling_latency_s":0.614465} gitlab # [ 155.101853] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"442b57a327ef98366211e1d4","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-442b57a327ef98366211e1d4: done: 0.009683 sec","job_status":"done","queue_duration_s":0.614451,"scheduling_latency_s":0.614465,"redis_calls":13,"redis_duration_s":0.0016059999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009683,"completed_at":"2026-10-25T13:09:04.113Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.142311] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad208e068384cf175fec3405","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad208e068384cf175fec3405: start","job_status":"start","queue_duration_s":0.625014,"scheduling_latency_s":0.625027} gitlab # [ 155.143104] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad208e068384cf175fec3405","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad208e068384cf175fec3405: done: 0.009778 sec","job_status":"done","queue_duration_s":0.625014,"scheduling_latency_s":0.625027,"redis_calls":13,"redis_duration_s":0.001616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009778,"completed_at":"2026-10-25T13:09:04.124Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.186738] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6bb9b96b880f07fdd4afb04","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6bb9b96b880f07fdd4afb04: start","job_status":"start","queue_duration_s":0.635631,"scheduling_latency_s":0.635645} gitlab # [ 155.188704] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6bb9b96b880f07fdd4afb04","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6bb9b96b880f07fdd4afb04: done: 0.00972 sec","job_status":"done","queue_duration_s":0.635631,"scheduling_latency_s":0.635645,"redis_calls":13,"redis_duration_s":0.0015829999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00972,"completed_at":"2026-10-25T13:09:04.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.242105] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfa5156fd02c118497e9bf11","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfa5156fd02c118497e9bf11: start","job_status":"start","queue_duration_s":0.646159,"scheduling_latency_s":0.646198} gitlab # [ 155.242862] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfa5156fd02c118497e9bf11","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfa5156fd02c118497e9bf11: done: 0.010372 sec","job_status":"done","queue_duration_s":0.646159,"scheduling_latency_s":0.646198,"redis_calls":13,"redis_duration_s":0.001625,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010372,"completed_at":"2026-10-25T13:09:04.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.293775] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1646a7e64596666665ae801d","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1646a7e64596666665ae801d: start","job_status":"start","queue_duration_s":0.657367,"scheduling_latency_s":0.65738} gitlab # [ 155.294655] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1646a7e64596666665ae801d","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1646a7e64596666665ae801d: done: 0.009735 sec","job_status":"done","queue_duration_s":0.657367,"scheduling_latency_s":0.65738,"redis_calls":13,"redis_duration_s":0.001674,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009735,"completed_at":"2026-10-25T13:09:04.156Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.346108] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01e73bb8cdc5800d4b8eeeca","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01e73bb8cdc5800d4b8eeeca: start","job_status":"start","queue_duration_s":0.667927,"scheduling_latency_s":0.667939} gitlab # [ 155.346907] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01e73bb8cdc5800d4b8eeeca","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01e73bb8cdc5800d4b8eeeca: done: 0.009491 sec","job_status":"done","queue_duration_s":0.667927,"scheduling_latency_s":0.667939,"redis_calls":13,"redis_duration_s":0.00154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009491,"completed_at":"2026-10-25T13:09:04.167Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.366945] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50f5ab2c8b8a3b8960cd5752","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50f5ab2c8b8a3b8960cd5752: start","job_status":"start","queue_duration_s":0.6784,"scheduling_latency_s":0.678413} gitlab # [ 155.409529] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50f5ab2c8b8a3b8960cd5752","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50f5ab2c8b8a3b8960cd5752: done: 0.009587 sec","job_status":"done","queue_duration_s":0.6784,"scheduling_latency_s":0.678413,"redis_calls":13,"redis_duration_s":0.001622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009587,"completed_at":"2026-10-25T13:09:04.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.453401] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3f8e9364ed59530dcc1aacc","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3f8e9364ed59530dcc1aacc: start","job_status":"start","queue_duration_s":0.689219,"scheduling_latency_s":0.689232} gitlab # [ 155.454241] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3f8e9364ed59530dcc1aacc","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3f8e9364ed59530dcc1aacc: done: 0.009544 sec","job_status":"done","queue_duration_s":0.689219,"scheduling_latency_s":0.689232,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009544,"completed_at":"2026-10-25T13:09:04.188Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.496498] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d950445664b9ef0b12a9b9f","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d950445664b9ef0b12a9b9f: start","job_status":"start","queue_duration_s":0.69976,"scheduling_latency_s":0.699774} gitlab # [ 155.497153] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d950445664b9ef0b12a9b9f","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d950445664b9ef0b12a9b9f: done: 0.009767 sec","job_status":"done","queue_duration_s":0.69976,"scheduling_latency_s":0.699774,"redis_calls":13,"redis_duration_s":0.0019399999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009767,"completed_at":"2026-10-25T13:09:04.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.509235] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b9b880a5e50de27a6b524c0","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b9b880a5e50de27a6b524c0: start","job_status":"start","queue_duration_s":0.710548,"scheduling_latency_s":0.710563} gitlab # [ 155.555813] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b9b880a5e50de27a6b524c0","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b9b880a5e50de27a6b524c0: done: 0.009581 sec","job_status":"done","queue_duration_s":0.710548,"scheduling_latency_s":0.710563,"redis_calls":13,"redis_duration_s":0.001764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009581,"completed_at":"2026-10-25T13:09:04.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.557124] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaa07cdfd9e5856c268fd1af","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaa07cdfd9e5856c268fd1af: start","job_status":"start","queue_duration_s":0.721122,"scheduling_latency_s":0.721134} gitlab # [ 155.605972] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaa07cdfd9e5856c268fd1af","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaa07cdfd9e5856c268fd1af: done: 0.009459 sec","job_status":"done","queue_duration_s":0.721122,"scheduling_latency_s":0.721134,"redis_calls":13,"redis_duration_s":0.001554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009459,"completed_at":"2026-10-25T13:09:04.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.607059] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f72867b6bbef9ad4c4c13ee4","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f72867b6bbef9ad4c4c13ee4: start","job_status":"start","queue_duration_s":0.731546,"scheduling_latency_s":0.731561} gitlab # [ 155.652202] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f72867b6bbef9ad4c4c13ee4","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f72867b6bbef9ad4c4c13ee4: done: 0.009732 sec","job_status":"done","queue_duration_s":0.731546,"scheduling_latency_s":0.731561,"redis_calls":13,"redis_duration_s":0.001593,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009732,"completed_at":"2026-10-25T13:09:04.230Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.653242] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc590ced78724efd9f89fbc6","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc590ced78724efd9f89fbc6: start","job_status":"start","queue_duration_s":0.741985,"scheduling_latency_s":0.741999} gitlab # [ 155.700166] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc590ced78724efd9f89fbc6","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc590ced78724efd9f89fbc6: done: 0.009766 sec","job_status":"done","queue_duration_s":0.741985,"scheduling_latency_s":0.741999,"redis_calls":13,"redis_duration_s":0.001709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009766,"completed_at":"2026-10-25T13:09:04.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.701194] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"193408e77b2e74fbe9b746ca","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-193408e77b2e74fbe9b746ca: start","job_status":"start","queue_duration_s":0.752563,"scheduling_latency_s":0.752576} gitlab # [ 155.744092] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"193408e77b2e74fbe9b746ca","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-193408e77b2e74fbe9b746ca: done: 0.009664 sec","job_status":"done","queue_duration_s":0.752563,"scheduling_latency_s":0.752576,"redis_calls":13,"redis_duration_s":0.001611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009664,"completed_at":"2026-10-25T13:09:04.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.746106] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49510eea54475896a6c2dfa9","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49510eea54475896a6c2dfa9: start","job_status":"start","queue_duration_s":0.76304,"scheduling_latency_s":0.763053} gitlab # [ 155.789525] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49510eea54475896a6c2dfa9","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49510eea54475896a6c2dfa9: done: 0.009705 sec","job_status":"done","queue_duration_s":0.76304,"scheduling_latency_s":0.763053,"redis_calls":13,"redis_duration_s":0.001728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009705,"completed_at":"2026-10-25T13:09:04.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.793086] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"849dae7370cac781aecd23c1","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-849dae7370cac781aecd23c1: start","job_status":"start","queue_duration_s":0.773579,"scheduling_latency_s":0.773591} gitlab # [ 155.839126] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"849dae7370cac781aecd23c1","created_at":"2026-10-25T13:09:03.396Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-25537ab51b074d49","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e29baa700c76119f2b93c0b3ebf37e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.489Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-849dae7370cac781aecd23c1: done: 0.009687 sec","job_status":"done","queue_duration_s":0.773579,"scheduling_latency_s":0.773591,"redis_calls":13,"redis_duration_s":0.0016550000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009687,"completed_at":"2026-10-25T13:09:04.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.840506] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.273Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8d271656a844b45aaaf6770b","created_at":"2026-10-25T13:09:03.622Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-6eb366287c9046d3","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42365cf0aea8504ea296e7e5b410a25e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.629Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8d271656a844b45aaaf6770b: start","job_status":"start","queue_duration_s":0.643999,"scheduling_latency_s":0.644012} gitlab # [ 155.851699] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.284Z","message":"No existing merge request to be cleaned up."} gitlab # [ 155.853509] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.292Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8d271656a844b45aaaf6770b","created_at":"2026-10-25T13:09:03.622Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-6eb366287c9046d3","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42365cf0aea8504ea296e7e5b410a25e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.629Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8d271656a844b45aaaf6770b: done: 0.018576 sec","job_status":"done","queue_duration_s":0.643999,"scheduling_latency_s":0.644012,"redis_calls":13,"redis_duration_s":0.001705,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000785,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000253105,"duration_s":0.018576,"completed_at":"2026-10-25T13:09:04.292Z","load_balancing_strategy":"primary","db_duration_s":0.002406,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.899509] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.293Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0d155dc92bea04d893056465","created_at":"2026-10-25T13:09:03.622Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-6eb366287c9046d3","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42365cf0aea8504ea296e7e5b410a25e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.629Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0d155dc92bea04d893056465: start","job_status":"start","queue_duration_s":0.663536,"scheduling_latency_s":0.66355} gitlab # [ 155.901087] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.300Z","message":"No existing merge request to be cleaned up."} gitlab # [ 155.902748] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.304Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0d155dc92bea04d893056465","created_at":"2026-10-25T13:09:03.622Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-6eb366287c9046d3","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42365cf0aea8504ea296e7e5b410a25e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.629Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0d155dc92bea04d893056465: done: 0.011539 sec","job_status":"done","queue_duration_s":0.663536,"scheduling_latency_s":0.66355,"redis_calls":10,"redis_duration_s":0.001485,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000823,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011539,"completed_at":"2026-10-25T13:09:04.304Z","load_balancing_strategy":"primary","db_duration_s":0.000936,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.943512] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.305Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"648b3262fa447771a490dd76","created_at":"2026-10-25T13:09:03.622Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-6eb366287c9046d3","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42365cf0aea8504ea296e7e5b410a25e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.629Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-648b3262fa447771a490dd76: start","job_status":"start","queue_duration_s":0.676079,"scheduling_latency_s":0.676118} gitlab # [ 155.948924] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.312Z","message":"No existing merge request to be cleaned up."} gitlab # [ 155.950554] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.316Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"648b3262fa447771a490dd76","created_at":"2026-10-25T13:09:03.622Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-6eb366287c9046d3","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42365cf0aea8504ea296e7e5b410a25e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.629Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-648b3262fa447771a490dd76: done: 0.011025 sec","job_status":"done","queue_duration_s":0.676079,"scheduling_latency_s":0.676118,"redis_calls":10,"redis_duration_s":0.00131,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011025,"completed_at":"2026-10-25T13:09:04.316Z","load_balancing_strategy":"primary","db_duration_s":0.000889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.991624] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.317Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"528c6a2b13f14572331cc391","created_at":"2026-10-25T13:09:03.622Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-6eb366287c9046d3","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42365cf0aea8504ea296e7e5b410a25e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.629Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-528c6a2b13f14572331cc391: start","job_status":"start","queue_duration_s":0.688118,"scheduling_latency_s":0.688133} gitlab # [ 155.996734] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.324Z","message":"No existing merge request to be cleaned up."} gitlab # [ 155.998602] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:04.329Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"528c6a2b13f14572331cc391","created_at":"2026-10-25T13:09:03.622Z","trace_propagation_headers":{"sentry-trace":"e6c22dbe409e499bbfac65a0314b193f-6eb366287c9046d3","baggage":"sentry-trace_id=e6c22dbe409e499bbfac65a0314b193f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42365cf0aea8504ea296e7e5b410a25e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:03.629Z","job_size_bytes":2,"pid":1659,"sidekiq_tid":"maen","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-528c6a2b13f14572331cc391: done: 0.011795 sec","job_status":"done","queue_duration_s":0.688118,"scheduling_latency_s":0.688133,"redis_calls":10,"redis_duration_s":0.001486,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011795,"completed_at":"2026-10-25T13:09:04.329Z","load_balancing_strategy":"primary","db_duration_s":0.001772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 156.224269] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1800859483 wd_nsec: 1800858727 gitlab # [ 160.934160] setup-gitlab-start[2229]: W, [2026-10-25T13:09:11.473553 #2229] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 182.830648] postgres[2426]: [2426] ERROR: relation "table_without_models" does not exist gitlab # [ 182.832355] postgres[2426]: [2426] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 186.292168] runuser[2228]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 186.293716] setup-gitlab-start[2203]: + systemctl restart gitlab-sidekiq.service gitlab # [ 186.311563] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 186.313281] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:36.850Z","message":"Shutting down"} gitlab # [ 186.314317] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:36.851Z","message":"Scheduler exiting..."} gitlab # [ 186.314977] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:36.851Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 186.315616] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:36.851Z","message":"Scheduler exiting..."} gitlab # [ 186.813530] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:37.352Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 189.316760] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:39.855Z","message":"Bye!"} gitlab # [ 189.331793] sidekiq-cluster[1659]: {"severity":"INFO","time":"2026-10-25T13:09:39.871Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1659,"worker_id":"sidekiq_0","memwd_rss_bytes":933941248,"retry":0} gitlab # [ 190.418567] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 190.419662] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 190.420643] systemd[1]: gitlab-sidekiq.service: Consumed 54.833s CPU time over 1min 53.018s wall clock time, 955.7M memory peak, 4.4M read from disk. gitlab # [ 190.423449] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 190.426438] setup-gitlab-start[2203]: + mkdir -p /var/lib/secrets gitlab # [ 190.429834] setup-gitlab-start[2203]: + echo nixbot-test-token-of-20-chars gitlab # [ 190.430764] setup-gitlab-start[2203]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 190.432813] setup-gitlab-start[2203]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars gitlab # [ 190.713516] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:41 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 255 gitlab # [ 191.146064] gitaly[900]: time="2026-10-25T13:09:41.685Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:51.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:41.684" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.147558] gitaly[900]: time="2026-10-25T13:09:41.685Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:51.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:41.684" grpc.time_ms=0.24 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.277674] gitaly[900]: time="2026-10-25T13:09:41.817Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:51.136" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:41.817" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.279870] gitaly[900]: time="2026-10-25T13:09:41.817Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:51.136" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:41.817" grpc.time_ms=0.354 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.331784] gitaly[900]: time="2026-10-25T13:09:41.871Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 diskcache=64342b7e-6e1a-4c63-8824-30e7ab63afa9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-25T13:09:51.144" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:41.825" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.341302] gitaly[900]: time="2026-10-25T13:09:41.871Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1582 command.oublock=32 command.real_time_ms=21 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-25T13:09:51.144" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:41.825" grpc.time_ms=46.178 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.368276] gitaly[900]: time="2026-10-25T13:09:41.907Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:51.227" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:41.907" pid=900 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 191.369382] gitaly[900]: time="2026-10-25T13:09:41.908Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:51.227" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:41.907" grpc.time_ms=0.491 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.400113] gitaly[900]: time="2026-10-25T13:09:41.939Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T13:09:51.252" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:41.932" grpc.time_ms=6.174 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.468783] gitaly[900]: time="2026-10-25T13:09:42.008Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:52.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:42.008" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.478519] gitaly[900]: time="2026-10-25T13:09:42.008Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:52.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:42.008" grpc.time_ms=0.216 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.505931] gitaly[900]: time="2026-10-25T13:09:42.045Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 diskcache=6b827906-a29a-44ec-8727-5ca852398985 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-25T13:09:52.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:42.010" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.515576] gitaly[900]: time="2026-10-25T13:09:42.046Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1579 command.oublock=32 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-25T13:09:52.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:42.010" grpc.time_ms=35.558 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.516249] gitaly[900]: time="2026-10-25T13:09:42.052Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:52.050" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:42.050" pid=900 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 191.516836] gitaly[900]: time="2026-10-25T13:09:42.052Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:52.050" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:42.050" grpc.time_ms=1.501 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.552099] gitaly[900]: time="2026-10-25T13:09:42.091Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=31 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T13:09:52.054" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:42.055" grpc.time_ms=36.539 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.583155] gitaly[900]: time="2026-10-25T13:09:42.122Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:09:52.122" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:42.122" grpc.time_ms=0.124 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.593271] gitaly[900]: time="2026-10-25T13:09:42.133Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-25T13:09:52.132" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:42.132" grpc.time_ms=0.175 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.040228] gitaly[900]: time="2026-10-25T13:09:42.579Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWQRGCX3B12TGTJ0KSR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T13:09:52.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:42.574" grpc.time_ms=5.589 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.271207] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:42 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 1545 gitlab # [ 192.275587] setup-gitlab-start[2486]: {"id":1,"message":null,"error":null} gitlab # [ 193.475703] sidekiq-cluster[2473]: {"severity":"INFO","time":"2026-10-25T13:09:43.998Z","message":"Starting cluster with 1 processes"} gitlab # [ 197.410281] gitaly[900]: time="2026-10-25T13:09:47.949Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWY5VNHKZQSM5C7HWYPNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T13:09:57.258" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:47.939" grpc.time_ms=9.93 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.450149] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:47 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 153 gitlab # [ 197.455209] setup-gitlab-start[2203]: + mkdir -p /tmp/test-flake gitlab # [ 197.458160] setup-gitlab-start[2203]: + cd /tmp/test-flake gitlab # [ 197.459684] setup-gitlab-start[2203]: + git init -b master gitlab # [ 197.476581] setup-gitlab-start[2561]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 197.479203] setup-gitlab-start[2203]: + git config user.name test gitlab # [ 197.483670] setup-gitlab-start[2203]: + git config user.email test@example.com gitlab # [ 197.487667] setup-gitlab-start[2203]: + cat gitlab # [ 197.490893] setup-gitlab-start[2203]: + git add flake.nix gitlab # [ 197.495976] setup-gitlab-start[2203]: + git commit -m 'initial commit' gitlab # [ 197.517744] setup-gitlab-start[2566]: [master (root-commit) 956eff3] initial commit gitlab # [ 197.518476] setup-gitlab-start[2566]: 1 file changed, 10 insertions(+) gitlab # [ 197.518920] setup-gitlab-start[2566]: create mode 100644 flake.nix gitlab # [ 197.520268] setup-gitlab-start[2203]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 197.528931] setup-gitlab-start[2203]: + git push -u origin master gitlab # [ 197.584587] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:48 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 28 gitlab # [ 197.833623] gitaly[900]: time="2026-10-25T13:09:48.372Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYF1PWXGA0Z8TEXRKJGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:48.362" grpc.time_ms=10.569 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 197.864257] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:48 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 274 gitlab # [ 198.145729] gitaly[900]: time="2026-10-25T13:09:48.685Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T13:09:58.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:48.674" grpc.time_ms=10.252 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.188791] gitaly[900]: time="2026-10-25T13:09:48.728Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-25T13:10:18.018" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-25T13:09:48.718" grpc.time_ms=9.93 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.241321] gitaly[900]: time="2026-10-25T13:09:48.781Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5SJWYR298RZAHPB8XCHBVVF duration_ms=214ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 198.289171] gitaly[900]: time="2026-10-25T13:09:48.828Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5SJWYR298RZAHPB8XCHBVVF duration_ms=41ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 198.300601] gitaly[900]: time="2026-10-25T13:09:48.829Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:09:48.565" grpc.time_ms=263.479 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.322994] gitaly[900]: time="2026-10-25T13:09:48.856Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:09:48.856" grpc.time_ms=0.437 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.361822] gitaly[900]: time="2026-10-25T13:09:48.901Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:09:48.901" grpc.time_ms=0.394 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.392458] gitaly[900]: time="2026-10-25T13:09:48.932Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:09:48.931" grpc.time_ms=0.255 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.507180] gitaly[900]: time="2026-10-25T13:09:49.046Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T13:09:59.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:49.034" grpc.time_ms=10.979 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.535889] gitaly[900]: time="2026-10-25T13:09:49.067Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1563 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-25T13:09:59.021" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:09:49.052" grpc.time_ms=14.883 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.557272] gitaly[900]: time="2026-10-25T13:09:49.077Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5SJWYR298RZAHPB8XCHBVVF duration_ms=119ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 198.560419] gitaly[900]: time="2026-10-25T13:09:49.078Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:09:48.957" grpc.time_ms=120.385 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.569887] gitaly[900]: time="2026-10-25T13:09:49.105Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF diskcache=a2eb4bfa-7c21-4632-8bc7-12c177e8e148 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:48.498" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.579045] gitlab-workhorse[825]: time="2026-10-25T13:09:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 198.580820] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:49 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 687 gitlab # [ 198.582662] setup-gitlab-start[2570]: To http://gitlab/root/test-flake.git gitlab # [ 198.583564] setup-gitlab-start[2570]: * [new branch] master -> master gitlab # [ 198.584447] setup-gitlab-start[2570]: branch 'master' set up to track 'origin/master'. gitlab # [ 198.585469] gitaly[900]: time="2026-10-25T13:09:49.105Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=178 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13801 command.oublock=32 command.real_time_ms=597 command.spawn_token_fork_ms=0 command.system_time_ms=124 command.user_time_ms=54 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:48.498" grpc.time_ms=606.761 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.597705] systemd[1]: Finished setup-gitlab.service. gitlab # [ 198.598527] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 199.80 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 199.611564] nixbot[2655]: {"ts": "2026-10-25T13:09:50.150Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 199.646630] nixbot[2655]: {"ts": "2026-10-25T13:09:50.186Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 199.673048] nixbot[2655]: {"ts": "2026-10-25T13:09:50.212Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 199.678495] nixbot[2655]: {"ts": "2026-10-25T13:09:50.218Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 199.683170] nixbot[2655]: {"ts": "2026-10-25T13:09:50.222Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 199.691842] nixbot[2655]: {"ts": "2026-10-25T13:09:50.231Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 199.696257] nixbot[2655]: {"ts": "2026-10-25T13:09:50.235Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 199.700414] nixbot[2655]: {"ts": "2026-10-25T13:09:50.238Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 199.706344] nixbot[2655]: {"ts": "2026-10-25T13:09:50.246Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 199.710503] nixbot[2655]: {"ts": "2026-10-25T13:09:50.248Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 199.714401] nixbot[2655]: {"ts": "2026-10-25T13:09:50.254Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 199.720552] nixbot[2655]: {"ts": "2026-10-25T13:09:50.260Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 199.726583] nixbot[2655]: {"ts": "2026-10-25T13:09:50.266Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 199.730620] nixbot[2655]: {"ts": "2026-10-25T13:09:50.270Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 199.736722] nixbot[2655]: {"ts": "2026-10-25T13:09:50.276Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 199.740468] nixbot[2655]: {"ts": "2026-10-25T13:09:50.280Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 199.744316] nixbot[2655]: {"ts": "2026-10-25T13:09:50.283Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 199.747843] nixbot[2655]: {"ts": "2026-10-25T13:09:50.287Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 199.753584] nixbot[2655]: {"ts": "2026-10-25T13:09:50.293Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 199.757372] nixbot[2655]: {"ts": "2026-10-25T13:09:50.297Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 199.761102] nixbot[2655]: {"ts": "2026-10-25T13:09:50.300Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 199.767196] nixbot[2655]: {"ts": "2026-10-25T13:09:50.306Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 199.771389] nixbot[2655]: {"ts": "2026-10-25T13:09:50.311Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 199.775512] nixbot[2655]: {"ts": "2026-10-25T13:09:50.315Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 199.779184] nixbot[2655]: {"ts": "2026-10-25T13:09:50.318Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 199.783289] nixbot[2655]: {"ts": "2026-10-25T13:09:50.322Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"} gitlab # [ 199.787384] nixbot[2655]: {"ts": "2026-10-25T13:09:50.326Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"} gitlab # [ 199.791250] nixbot[2655]: {"ts": "2026-10-25T13:09:50.330Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"} gitlab # [ 199.794978] nixbot[2655]: {"ts": "2026-10-25T13:09:50.334Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"} gitlab # [ 199.812338] nixbot[2655]: {"ts": "2026-10-25T13:09:50.351Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"} gitlab # [ 199.818993] nixbot[2655]: {"ts": "2026-10-25T13:09:50.358Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"} gitlab # [ 199.823100] nixbot[2655]: {"ts": "2026-10-25T13:09:50.362Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"} gitlab # [ 199.826790] nixbot[2655]: {"ts": "2026-10-25T13:09:50.366Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"} gitlab # [ 199.832298] nixbot[2655]: {"ts": "2026-10-25T13:09:50.371Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"} gitlab # [ 199.836189] nixbot[2655]: {"ts": "2026-10-25T13:09:50.375Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"} gitlab # [ 199.842719] nixbot[2655]: {"ts": "2026-10-25T13:09:50.382Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"} gitlab # [ 199.847685] nixbot[2655]: {"ts": "2026-10-25T13:09:50.387Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"} gitlab # [ 199.852902] nixbot[2655]: {"ts": "2026-10-25T13:09:50.392Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"} gitlab # [ 200.185317] nixbot[2655]: {"ts": "2026-10-25T13:09:50.724Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2655]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"} gitlab # [ 200.190904] nixbot[2655]: {"ts": "2026-10-25T13:09:50.725Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"} gitlab # [ 200.219423] nixbot[2655]: {"ts": "2026-10-25T13:09:50.758Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41506 - \"GET /health HTTP/1.1\" 200"} gitlab # [ 200.224839] systemd[1]: Started nixbot CI service. gitlab # [ 200.227142] systemd[1]: Reached target Multi-User System. gitlab # [ 200.228752] systemd[1]: Startup finished in 1.239s (kernel) + 3.393s (initrd) + 3min 15.595s (userspace) = 3min 20.228s. gitlab: (finished: waiting for unit nixbot.service, in 1.04 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 200.271081] nixbot[2655]: {"ts": "2026-10-25T13:09:50.809Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41514 - \"GET /health HTTP/1.1\" 200"} gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 200.335364] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 41 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.06 seconds) gitlab # [ 200.839120] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:51 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 619 gitlab # [ 200.860225] nixbot[2655]: {"ts": "2026-10-25T13:09:51.399Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 200.913991] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 37 gitlab # [ 200.918940] nixbot[2655]: {"ts": "2026-10-25T13:09:51.455Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 201.079054] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 161 gitlab # [ 201.219311] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:51 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 131 gitlab # [ 201.307327] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 70 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 201.365692] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:51 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 47 gitlab # [ 201.409095] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 37 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds) (finished: subtest: project discovered and webhook registered, in 1.14 seconds) subtest: push delivers the webhook gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails' gitlab # [ 201.427982] gitaly[900]: time="2026-10-25T13:09:51.966Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX25A3T9PRA3DH4TMPWAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-25T13:10:21.054" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:09:51.954" grpc.time_ms=10.836 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.436632] gitaly[900]: time="2026-10-25T13:09:51.976Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX25A3T9PRA3DH4TMPWAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:10:21.075" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:09:51.975" grpc.time_ms=0.674 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.447080] gitaly[900]: time="2026-10-25T13:09:51.986Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX25A3T9PRA3DH4TMPWAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-25T13:10:01.008" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:09:51.979" grpc.time_ms=6.038 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.467590] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 92 gitlab # [ 201.528839] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 57 gitlab # [ 201.531653] nixbot[2655]: {"ts": "2026-10-25T13:09:52.071Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 201.618554] gitaly[900]: time="2026-10-25T13:09:52.158Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2BRFNK5D46X1D1VA1D5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.151" grpc.time_ms=7.091 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.620091] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 38 gitlab # [ 201.739522] gitaly[900]: time="2026-10-25T13:09:52.279Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2D02KHBHEM4FXWK151Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.271" pid=900 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 201.740684] gitaly[900]: time="2026-10-25T13:09:52.279Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2D02KHBHEM4FXWK151Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.271" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.741833] gitlab-workhorse[825]: time="2026-10-25T13:09:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 201.743016] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 119 gitlab # [ 201.745956] gitaly[900]: time="2026-10-25T13:09:52.279Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2D02KHBHEM4FXWK151Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.271" grpc.time_ms=8.332 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.796949] gitaly[900]: time="2026-10-25T13:09:52.336Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2GTZPDF4XP4AFN92B1V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.324" pid=900 remote_ip="2001:db8:1::1" request_sha=bdaef5af18926f912af98d4b836ff37d7a04245c response_bytes=223 span.kind=server system=grpc gitlab # [ 201.811248] gitaly[900]: time="2026-10-25T13:09:52.336Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2GTZPDF4XP4AFN92B1V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.324" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.811996] gitlab-workhorse[825]: time="2026-10-25T13:09:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 201.812432] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 54 gitlab # [ 201.812760] gitaly[900]: time="2026-10-25T13:09:52.336Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2GTZPDF4XP4AFN92B1V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.324" grpc.time_ms=12.651 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.904857] gitaly[900]: time="2026-10-25T13:09:52.444Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2MQTZXGMR57HTZ065PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.439" grpc.time_ms=4.821 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.905580] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 37 gitlab # [ 201.944477] gitaly[900]: time="2026-10-25T13:09:52.484Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2NZ9QPNMMBAJB7SHGH9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.478" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 201.945263] gitaly[900]: time="2026-10-25T13:09:52.484Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2NZ9QPNMMBAJB7SHGH9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.478" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.945986] gitlab-workhorse[825]: time="2026-10-25T13:09:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 201.946838] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 37 gitlab # [ 201.947393] gitaly[900]: time="2026-10-25T13:09:52.484Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2NZ9QPNMMBAJB7SHGH9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.478" grpc.time_ms=6.088 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.038057] gitaly[900]: time="2026-10-25T13:09:52.577Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2RW7CR9SGCBASA3CZXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.570" grpc.time_ms=7.048 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.053790] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 52 gitlab # [ 202.099225] gitaly[900]: time="2026-10-25T13:09:52.638Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2TMBJF4K7A4H724TW86 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.627" pid=900 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 202.099920] gitaly[900]: time="2026-10-25T13:09:52.639Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2TMBJF4K7A4H724TW86 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.627" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.102346] gitaly[900]: time="2026-10-25T13:09:52.642Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2TMBJF4K7A4H724TW86 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:09:52.627" grpc.time_ms=14.178 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.143439] gitlab-workhorse[825]: time="2026-10-25T13:09:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 202.144619] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 87 gitlab # [ 202.210268] gitaly[900]: time="2026-10-25T13:09:52.749Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:10:22.048" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:09:52.749" grpc.time_ms=0.676 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.273516] gitaly[900]: time="2026-10-25T13:09:52.813Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-25T13:10:22.101" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:09:52.802" grpc.time_ms=10.812 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.320375] gitaly[900]: time="2026-10-25T13:09:52.860Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:02.184" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:09:52.855" grpc.time_ms=4.815 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.356287] gitaly[900]: time="2026-10-25T13:09:52.896Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:02.220" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:09:52.890" grpc.time_ms=5.768 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.403875] gitaly[900]: time="2026-10-25T13:09:52.943Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-25T13:10:02.273" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:52.943" grpc.time_ms=0.182 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.419438] gitaly[900]: time="2026-10-25T13:09:52.959Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-25T13:10:02.283" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:09:52.953" grpc.time_ms=5.213 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.450409] gitaly[900]: time="2026-10-25T13:09:52.989Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:09:52.989" grpc.time_ms=0.253 pid=900 span.kind=server system=grpc gitlab # [ 202.473494] gitaly[900]: time="2026-10-25T13:09:53.013Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:09:53.012" grpc.time_ms=0.235 pid=900 span.kind=server system=grpc gitlab # [ 202.490459] gitaly[900]: time="2026-10-25T13:09:53.030Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM diskcache=170c1449-cb5e-4600-ba8d-5e5c4e969935 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T13:10:02.010" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:52.960" pid=900 ref=refs/keep-around/956eff33a93dfc78e6549841cc9fd4b4bc74aee8 remote_ip="2001:db8:1::1" revision=956eff33a93dfc78e6549841cc9fd4b4bc74aee8 span.kind=server system=grpc username=root gitlab # [ 202.495078] gitaly[900]: time="2026-10-25T13:09:53.031Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=58 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5270 command.oublock=8 command.real_time_ms=62 command.spawn_token_fork_ms=1 command.system_time_ms=45 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T13:10:02.010" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:09:52.960" grpc.time_ms=70.487 pid=900 ref=refs/keep-around/956eff33a93dfc78e6549841cc9fd4b4bc74aee8 remote_ip="2001:db8:1::1" revision=956eff33a93dfc78e6549841cc9fd4b4bc74aee8 span.kind=server system=grpc username=root gitlab # [ 202.502149] gitaly[900]: time="2026-10-25T13:09:53.034Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:10:23.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:09:53.034" grpc.time_ms=0.342 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.600177] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:09:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/956eff33a93dfc78e6549841cc9fd4b4bc74aee8 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 429 gitlab # [ 202.612243] nixbot[2655]: {"ts": "2026-10-25T13:09:53.151Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-956eff33a93d-0"} gitlab # [ 202.731521] nixbot[2655]: {"ts": "2026-10-25T13:09:53.271Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-956eff33a93d-0", "argv0": "bwrap"} gitlab # [ 202.797397] systemd[1]: Started Nix Daemon. gitlab # [ 202.861209] nix-daemon[2816]: accepted connection from pid 2811, user nixbot gitlab # [ 207.889334] nix-daemon[2816]: accepted connection from pid 2865, user nixbot gitlab # [ 207.903134] nix-daemon[2816]: accepted connection from pid 2811, user nixbot gitlab # [ 212.271213] nix-daemon[2816]: accepted connection from pid 2811, user nixbot gitlab # [ 212.327993] nix-daemon[2816]: accepted connection from pid 2908, user nixbot gitlab # [ 212.377916] gitaly[900]: time="2026-10-25T13:10:02.917Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJXCVDBKJ0DTGJ7EQZN48A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:10:32.213" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:02.913" grpc.time_ms=2.872 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.408150] gitaly[900]: time="2026-10-25T13:10:02.947Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJXCVDBKJ0DTGJ7EQZN48A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:12.267" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:02.938" grpc.time_ms=9.587 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.443250] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/956eff33a93dfc78e6549841cc9fd4b4bc74aee8 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 121 gitlab # [ 212.498837] gitaly[900]: time="2026-10-25T13:10:03.038Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJXCZEEKWCEHVXYESBP3E3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:10:33.037" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:03.038" grpc.time_ms=0.501 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.591475] gitaly[900]: time="2026-10-25T13:10:03.131Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5SJXCZEEKWCEHVXYESBP3E3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:13.120" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:03.121" grpc.time_ms=9.881 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.697049] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/956eff33a93dfc78e6549841cc9fd4b4bc74aee8 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 245 gitlab # [ 216.982885] nix-daemon[2816]: accepted connection from pid 2983, user nixbot gitlab # [ 217.069071] gitaly[900]: time="2026-10-25T13:10:07.608Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJXHDT28V144MSBF1XA1AJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:10:37.606" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:07.607" grpc.time_ms=0.664 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 217.129571] gitaly[900]: time="2026-10-25T13:10:07.669Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJXHDT28V144MSBF1XA1AJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:17.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:07.663" grpc.time_ms=5.935 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 217.193371] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/956eff33a93dfc78e6549841cc9fd4b4bc74aee8 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 185 gitlab # [ 217.428628] nixbot[2655]: {"ts": "2026-10-25T13:10:07.967Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "956eff33a93dfc78e6549841cc9fd4b4bc74aee8", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []} gitlab # [ 217.538540] gitaly[900]: time="2026-10-25T13:10:08.078Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJXHWG3K44CP5CSG62V76H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:08.070" grpc.time_ms=7.637 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 217.567770] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 62 gitlab # [ 217.594663] gitaly[900]: time="2026-10-25T13:10:08.134Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJXHYGEF3HG1PPFF38CSWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:08.122" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 217.595382] gitaly[900]: time="2026-10-25T13:10:08.134Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJXHYGEF3HG1PPFF38CSWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:08.122" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 217.596589] gitaly[900]: time="2026-10-25T13:10:08.136Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJXHYGEF3HG1PPFF38CSWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:08.122" grpc.time_ms=13.125 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 217.596829] gitlab-workhorse[825]: time="2026-10-25T13:10:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 217.598092] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 55 gitlab # [ 217.701050] gitaly[900]: time="2026-10-25T13:10:08.240Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJXJ24PWB5HEQFWXZJJY5S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:08.234" grpc.time_ms=5.951 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 217.702227] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 44 gitlab # [ 217.747049] gitaly[900]: time="2026-10-25T13:10:08.286Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJXJ3MNZ153DBY6YXMTQP5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:08.280" pid=900 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 217.756060] gitaly[900]: time="2026-10-25T13:10:08.287Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJXJ3MNZ153DBY6YXMTQP5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:08.280" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 217.767965] gitlab-workhorse[825]: time="2026-10-25T13:10:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 217.768526] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 43 gitlab # [ 217.769083] gitaly[900]: time="2026-10-25T13:10:08.287Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJXJ3MNZ153DBY6YXMTQP5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:08.280" grpc.time_ms=7.374 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 218.080745] sidekiq-cluster[2533]: 2026-10-25T13:10:08.619Z pid=2533 tid=xu5 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2533, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430972928} gitlab # [ 218.247302] sidekiq-cluster[2533]: W, [2026-10-25T13:10:08.786877 #2533] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 218.284075] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:08.823Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 219.957575] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:10.496Z","message":"GitLab reliable fetch activated!"} gitlab # [ 219.958990] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:10.496Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 239.395559] postgres[3204]: [3204] ERROR: relation "table_without_models" does not exist gitlab # [ 239.397167] postgres[3204]: [3204] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 241.750543] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:32.289Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 241.753686] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:32.293Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 241.754559] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:32.293Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 241.755673] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:32.293Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 241.756834] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:32.294Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 41.39 seconds) gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 242.901513] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:33 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 45 gitlab # [ 242.975694] gitaly[900]: time="2026-10-25T13:10:33.514Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYAQ669K8AQTTRK3PVW2R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:33.505" grpc.time_ms=8.855 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 243.005615] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:33 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 67 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 243.055585] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:33.594Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7322b089d10abd094855cc9d","created_at":"2026-10-25T13:09:41.959Z","trace_propagation_headers":{"sentry-trace":"69c290248282494abc9fb056a85829b4-d25c32d6b13a45da","baggage":"sentry-trace_id=69c290248282494abc9fb056a85829b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWQRGCX3B12TGTJ0KSR93","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:41.994Z","job_size_bytes":2,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7322b089d10abd094855cc9d: start","job_status":"start","queue_duration_s":51.600084,"scheduling_latency_s":51.600151} gitlab # [ 243.167396] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:33.706Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7322b089d10abd094855cc9d","created_at":"2026-10-25T13:09:41.959Z","trace_propagation_headers":{"sentry-trace":"69c290248282494abc9fb056a85829b4-d25c32d6b13a45da","baggage":"sentry-trace_id=69c290248282494abc9fb056a85829b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWQRGCX3B12TGTJ0KSR93","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:41.994Z","job_size_bytes":2,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7322b089d10abd094855cc9d: done: 0.11279 sec","job_status":"done","queue_duration_s":51.600084,"scheduling_latency_s":51.600151,"redis_calls":25,"redis_duration_s":0.003792,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.002394,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00079,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000608,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.059208643,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.11279,"completed_at":"2026-10-25T13:10:33.706Z","load_balancing_strategy":"primary","db_duration_s":0.029681,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.168996] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:33.707Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"cec4783de2afd4812485157c","created_at":"2026-10-25T13:09:42.001Z","trace_propagation_headers":{"sentry-trace":"69c290248282494abc9fb056a85829b4-d25c32d6b13a45da","baggage":"sentry-trace_id=69c290248282494abc9fb056a85829b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWQRGCX3B12TGTJ0KSR93","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:42.004Z","job_size_bytes":2,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-cec4783de2afd4812485157c: start","job_status":"start","queue_duration_s":51.703092,"scheduling_latency_s":51.703135} gitlab # [ 243.232821] gitaly[900]: time="2026-10-25T13:10:33.726Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-25T13:11:03.720" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-25T13:10:33.721" grpc.time_ms=5.629 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.275016] gitaly[900]: time="2026-10-25T13:10:33.814Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT duration_ms=142ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 243.306746] gitaly[900]: time="2026-10-25T13:10:33.846Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT duration_ms=30ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 243.307655] gitaly[900]: time="2026-10-25T13:10:33.846Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:33.671" grpc.time_ms=175.126 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 243.338264] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:33.877Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"cec4783de2afd4812485157c","created_at":"2026-10-25T13:09:42.001Z","trace_propagation_headers":{"sentry-trace":"69c290248282494abc9fb056a85829b4-d25c32d6b13a45da","baggage":"sentry-trace_id=69c290248282494abc9fb056a85829b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWQRGCX3B12TGTJ0KSR93","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:42.004Z","job_size_bytes":2,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-cec4783de2afd4812485157c: done: 0.169842 sec","job_status":"done","queue_duration_s":51.703092,"scheduling_latency_s":51.703135,"redis_calls":14,"redis_duration_s":0.002237,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000401,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000711,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.151965124,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.169842,"completed_at":"2026-10-25T13:10:33.877Z","load_balancing_strategy":"primary","db_duration_s":0.096347,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.339859] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:33.878Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"5fee74f1965bc1a25c0b55df","created_at":"2026-10-25T13:09:42.495Z","trace_propagation_headers":{"sentry-trace":"69c290248282494abc9fb056a85829b4-d25c32d6b13a45da","baggage":"sentry-trace_id=69c290248282494abc9fb056a85829b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWQRGCX3B12TGTJ0KSR93","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:42.500Z","job_size_bytes":5,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-5fee74f1965bc1a25c0b55df: start","job_status":"start","queue_duration_s":51.378093,"scheduling_latency_s":51.378107} gitlab # [ 243.393635] gitaly[900]: time="2026-10-25T13:10:33.933Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:33.932" grpc.time_ms=0.613 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 243.439186] gitaly[900]: time="2026-10-25T13:10:33.978Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:33.978" grpc.time_ms=0.3 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 243.453795] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:33.993Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"5fee74f1965bc1a25c0b55df","created_at":"2026-10-25T13:09:42.495Z","trace_propagation_headers":{"sentry-trace":"69c290248282494abc9fb056a85829b4-d25c32d6b13a45da","baggage":"sentry-trace_id=69c290248282494abc9fb056a85829b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWQRGCX3B12TGTJ0KSR93","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:42.500Z","job_size_bytes":5,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-5fee74f1965bc1a25c0b55df: done: 0.114569 sec","job_status":"done","queue_duration_s":51.378093,"scheduling_latency_s":51.378107,"redis_calls":12,"redis_duration_s":0.001547,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000396,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196673,"duration_s":0.114569,"completed_at":"2026-10-25T13:10:33.993Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021188,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.454769] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:33.994Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"a28ef2274d9400ba9fd63a6d","created_at":"2026-10-25T13:09:42.522Z","trace_propagation_headers":{"sentry-trace":"69c290248282494abc9fb056a85829b4-d25c32d6b13a45da","baggage":"sentry-trace_id=69c290248282494abc9fb056a85829b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWQRGCX3B12TGTJ0KSR93","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:42.526Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-a28ef2274d9400ba9fd63a6d: start","job_status":"start","queue_duration_s":51.468267,"scheduling_latency_s":51.468283} gitlab # [ 243.518880] gitaly[900]: time="2026-10-25T13:10:34.058Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:34.057" grpc.time_ms=0.662 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 243.572946] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:34.112Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"a28ef2274d9400ba9fd63a6d","created_at":"2026-10-25T13:09:42.522Z","trace_propagation_headers":{"sentry-trace":"69c290248282494abc9fb056a85829b4-d25c32d6b13a45da","baggage":"sentry-trace_id=69c290248282494abc9fb056a85829b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWQRGCX3B12TGTJ0KSR93","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:42.526Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-a28ef2274d9400ba9fd63a6d: done: 0.118064 sec","job_status":"done","queue_duration_s":51.468267,"scheduling_latency_s":51.468283,"redis_calls":11,"redis_duration_s":0.001537,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000372,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.096,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.096,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201701,"duration_s":0.118064,"completed_at":"2026-10-25T13:10:34.112Z","load_balancing_strategy":"primary","db_duration_s":0.035645,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.611886] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:34.151Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"8567bff8529204ef501263d9","created_at":"2026-10-25T13:09:42.528Z","trace_propagation_headers":{"sentry-trace":"69c290248282494abc9fb056a85829b4-d25c32d6b13a45da","baggage":"sentry-trace_id=69c290248282494abc9fb056a85829b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWQRGCX3B12TGTJ0KSR93","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:42.531Z","job_size_bytes":89,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-8567bff8529204ef501263d9: start","job_status":"start","queue_duration_s":51.620271,"scheduling_latency_s":51.620291} gitlab # [ 243.623940] gitaly[900]: time="2026-10-25T13:10:34.163Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT duration_ms=80ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 243.624652] gitaly[900]: time="2026-10-25T13:10:34.164Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:34.083" grpc.time_ms=81.137 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 243.647774] gitaly[900]: time="2026-10-25T13:10:34.187Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT diskcache=7f47a772-25ae-42f6-8c3f-672e384da7f4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:33.623" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 243.648878] gitaly[900]: time="2026-10-25T13:10:34.187Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=236 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13714 command.oublock=32 command.real_time_ms=555 command.spawn_token_fork_ms=0 command.system_time_ms=191 command.user_time_ms=45 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:33.623" grpc.time_ms=563.715 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 243.649778] gitlab-workhorse[825]: time="2026-10-25T13:10:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 243.650674] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:34 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 623 gitlab # To http://gitlab/root/test-flake.git gitlab # 956eff3..47f2943 master -> master gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.88 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a' gitlab # [ 243.694231] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:34.233Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"8567bff8529204ef501263d9","created_at":"2026-10-25T13:09:42.528Z","trace_propagation_headers":{"sentry-trace":"69c290248282494abc9fb056a85829b4-d25c32d6b13a45da","baggage":"sentry-trace_id=69c290248282494abc9fb056a85829b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWQRGCX3B12TGTJ0KSR93","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:42.531Z","job_size_bytes":89,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-8567bff8529204ef501263d9: done: 0.082138 sec","job_status":"done","queue_duration_s":51.620271,"scheduling_latency_s":51.620291,"redis_calls":11,"redis_duration_s":0.002104,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000661,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000351,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000248915,"duration_s":0.082138,"completed_at":"2026-10-25T13:10:34.233Z","load_balancing_strategy":"primary","db_duration_s":0.005063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.734418] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:34.273Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 956eff33a93dfc78e6549841cc9fd4b4bc74aee8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"da1de439cef1a24728bb1a17","created_at":"2026-10-25T13:09:48.988Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-dd8b9298718d4820","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:49.005Z","job_size_bytes":185,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-da1de439cef1a24728bb1a17: start","job_status":"start","queue_duration_s":45.268112,"scheduling_latency_s":45.268135} gitlab # [ 243.759899] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:34.299Z","message":"changes: \"0000000000000000000000000000000000000000 956eff33a93dfc78e6549841cc9fd4b4bc74aee8 refs/heads/master\\n\""} gitlab # [ 243.801587] nixbot[2655]: {"ts": "2026-10-25T13:10:34.340Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53996 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a HTTP/1.1\" 200"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a', in 0.12 seconds) gitlab # [ 243.808294] gitaly[900]: time="2026-10-25T13:10:34.348Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:44.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:34.336" grpc.time_ms=11.686 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.833127] gitaly[900]: time="2026-10-25T13:10:34.372Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T13:10:44.034" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:34.364" grpc.time_ms=8.498 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.886435] gitaly[900]: time="2026-10-25T13:10:34.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-25T13:10:44.088" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:34.418" grpc.time_ms=7.462 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.927482] gitaly[900]: time="2026-10-25T13:10:34.467Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:34.466" grpc.time_ms=0.248 pid=900 span.kind=server system=grpc gitlab # [ 243.963295] gitaly[900]: time="2026-10-25T13:10:34.502Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:34.502" grpc.time_ms=0.259 pid=900 span.kind=server system=grpc gitlab # [ 243.977496] gitaly[900]: time="2026-10-25T13:10:34.516Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF diskcache=fb970103-9197-48f0-88ef-8a2a8c539cb5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T13:10:44.102" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:34.433" pid=900 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 243.978700] gitaly[900]: time="2026-10-25T13:10:34.516Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=79 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4748 command.oublock=8 command.real_time_ms=78 command.spawn_token_fork_ms=0 command.system_time_ms=51 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T13:10:44.102" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:34.433" grpc.time_ms=83.57 pid=900 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 243.998957] gitaly[900]: time="2026-10-25T13:10:34.538Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T13:10:44.208" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:34.538" grpc.time_ms=0.108 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.010348] gitaly[900]: time="2026-10-25T13:10:34.550Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=943 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-25T13:10:44.212" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:34.543" grpc.time_ms=6.933 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.087331] gitaly[900]: time="2026-10-25T13:10:34.627Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-25T13:11:04.021" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:34.621" grpc.time_ms=5.177 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.123215] gitaly[900]: time="2026-10-25T13:10:34.662Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-25T13:10:44.001" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:34.662" grpc.time_ms=0.32 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.144612] gitaly[900]: time="2026-10-25T13:10:34.684Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-25T13:10:44.020" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-25T13:10:34.680" grpc.time_ms=3.603 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.177416] gitaly[900]: time="2026-10-25T13:10:34.717Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:44.049" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:34.710" grpc.time_ms=7.066 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.188031] gitaly[900]: time="2026-10-25T13:10:34.727Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:44.060" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:34.720" grpc.time_ms=7.057 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.219390] gitaly[900]: time="2026-10-25T13:10:34.759Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-25T13:11:04.147" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:34.747" grpc.time_ms=11.277 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.592269] gitaly[900]: time="2026-10-25T13:10:35.131Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-25T13:10:45.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:35.130" grpc.time_ms=1.051 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.655947] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.194Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 956eff33a93dfc78e6549841cc9fd4b4bc74aee8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"da1de439cef1a24728bb1a17","created_at":"2026-10-25T13:09:48.988Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-dd8b9298718d4820","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:09:49.005Z","job_size_bytes":185,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-da1de439cef1a24728bb1a17: done: 0.92045 sec","job_status":"done","queue_duration_s":45.268112,"scheduling_latency_s":45.268135,"gitaly_calls":13,"gitaly_duration_s":0.268855,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.059669,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.003059,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.004947,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001422,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002563,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.012225,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.035453,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.165,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.186,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.523783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000736406,"exclusive_lock_hold_duration_s":0.047563587,"duration_s":0.92045,"completed_at":"2026-10-25T13:10:35.194Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.073782,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.733643] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.272Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bad5d42ae23c5a9e442709e9","created_at":"2026-10-25T13:09:53.043Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-df6338188cf348d1","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:53.047Z","job_size_bytes":65,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bad5d42ae23c5a9e442709e9: start","job_status":"start","queue_duration_s":42.224968,"scheduling_latency_s":42.225017} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a' gitlab # [ 244.845438] nixbot[2655]: {"ts": "2026-10-25T13:10:35.384Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:54010 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a HTTP/1.1\" 200"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a', in 0.05 seconds) gitlab # [ 244.851999] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.385Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bad5d42ae23c5a9e442709e9","created_at":"2026-10-25T13:09:53.043Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-df6338188cf348d1","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:53.047Z","job_size_bytes":65,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bad5d42ae23c5a9e442709e9: done: 0.113298 sec","job_status":"done","queue_duration_s":42.224968,"scheduling_latency_s":42.225017,"redis_calls":16,"redis_duration_s":0.004242,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002255,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001557,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000504813,"duration_s":0.113298,"completed_at":"2026-10-25T13:10:35.385Z","load_balancing_strategy":"primary","db_duration_s":0.022616,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.904251] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.387Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d60892d6f952a37c5fe46fc9","created_at":"2026-10-25T13:09:53.048Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-df6338188cf348d1","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:53.050Z","job_size_bytes":65,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d60892d6f952a37c5fe46fc9: start","job_status":"start","queue_duration_s":42.336704,"scheduling_latency_s":42.336723} gitlab # [ 244.931243] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.470Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d60892d6f952a37c5fe46fc9","created_at":"2026-10-25T13:09:53.048Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-df6338188cf348d1","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:53.050Z","job_size_bytes":65,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d60892d6f952a37c5fe46fc9: done: 0.082769 sec","job_status":"done","queue_duration_s":42.336704,"scheduling_latency_s":42.336723,"redis_calls":21,"redis_duration_s":0.004784,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001821,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047548,"duration_s":0.082769,"completed_at":"2026-10-25T13:10:35.470Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.952392] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.472Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d821ddc4cdb33ae3900c7fac","created_at":"2026-10-25T13:09:53.123Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-df6338188cf348d1","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:53.127Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d821ddc4cdb33ae3900c7fac: start","job_status":"start","queue_duration_s":42.344936,"scheduling_latency_s":42.344966} gitlab # [ 245.083877] gitaly[900]: time="2026-10-25T13:10:35.623Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:35.623" grpc.time_ms=0.253 pid=900 span.kind=server system=grpc gitlab # [ 245.132110] gitaly[900]: time="2026-10-25T13:10:35.671Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:35.671" grpc.time_ms=0.266 pid=900 span.kind=server system=grpc gitlab # [ 245.179775] gitaly[900]: time="2026-10-25T13:10:35.719Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:35.718" grpc.time_ms=0.251 pid=900 span.kind=server system=grpc gitlab # [ 245.204996] gitaly[900]: time="2026-10-25T13:10:35.744Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM diskcache=9b82bc74-718e-4c04-88e2-a83ad73b0482 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T13:11:05.095" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:35.595" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.205771] gitaly[900]: time="2026-10-25T13:10:35.745Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=140 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7453 command.oublock=0 command.real_time_ms=143 command.spawn_token_fork_ms=0 command.system_time_ms=94 command.user_time_ms=46 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T13:11:05.095" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:35.595" grpc.time_ms=149.218 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.320536] gitaly[900]: time="2026-10-25T13:10:35.860Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T13:11:05.259" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:35.859" grpc.time_ms=0.676 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.367487] gitaly[900]: time="2026-10-25T13:10:35.907Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:05.305" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:35.906" grpc.time_ms=0.803 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.377292] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.916Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d821ddc4cdb33ae3900c7fac","created_at":"2026-10-25T13:09:53.123Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-df6338188cf348d1","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:53.127Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2533,"job_status":"rescheduled","message":"PipelineProcessWorker JID-d821ddc4cdb33ae3900c7fac: rescheduled"} gitlab # [ 245.383662] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.923Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d821ddc4cdb33ae3900c7fac","created_at":"2026-10-25T13:09:53.123Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-df6338188cf348d1","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T13:09:53.127Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d821ddc4cdb33ae3900c7fac: done: 0.45053 sec","job_status":"done","queue_duration_s":42.344936,"scheduling_latency_s":42.344966,"gitaly_calls":3,"gitaly_duration_s":0.178167,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.026504,"redis_read_bytes":460,"redis_write_bytes":29297,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001317,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001239,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.009271,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004049,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15584,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005654,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000582,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000717,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002358,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.072,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.018,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170187,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.39063903299999997,"duration_s":0.45053,"completed_at":"2026-10-25T13:10:35.923Z","load_balancing_strategy":"primary","db_duration_s":0.08514,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 245.450092] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.924Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","956eff33a93dfc78e6549841cc9fd4b4bc74aee8 47f294322ca552a961eaddfd759c569742c1f70a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c22ba85ca5120a51f401e44b","created_at":"2026-10-25T13:10:34.107Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-6031c91e78be4d9a","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:10:34.109Z","job_size_bytes":185,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c22ba85ca5120a51f401e44b: start","job_status":"start","queue_duration_s":1.814923,"scheduling_latency_s":1.814937} gitlab # [ 245.450681] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.932Z","message":"changes: \"956eff33a93dfc78e6549841cc9fd4b4bc74aee8 47f294322ca552a961eaddfd759c569742c1f70a refs/heads/master\\n\""} gitlab # [ 245.451176] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:35.963Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"7b280e400f46732236f16b6a","created_at":"2026-10-25T13:10:35.961Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-8cd6fe9d2f8641c9","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"8a2ef0779ca38ed33ef1961d","job_size_bytes":46,"pid":2533,"job_status":"deduplicated","message":"ProjectCacheWorker JID-7b280e400f46732236f16b6a: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 245.491459] gitaly[900]: time="2026-10-25T13:10:35.951Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:45.283" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:35.944" grpc.time_ms=6.814 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.492206] gitaly[900]: time="2026-10-25T13:10:35.959Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T13:10:45.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:35.954" grpc.time_ms=4.625 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.492879] gitaly[900]: time="2026-10-25T13:10:35.977Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-25T13:10:45.022" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:35.972" grpc.time_ms=5.099 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.493619] gitaly[900]: time="2026-10-25T13:10:35.987Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-25T13:11:05.382" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:35.982" grpc.time_ms=5.493 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.532601] gitaly[900]: time="2026-10-25T13:10:35.997Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-25T13:10:45.044" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-25T13:10:35.994" grpc.time_ms=2.893 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.533445] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:36.065Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","956eff33a93dfc78e6549841cc9fd4b4bc74aee8 47f294322ca552a961eaddfd759c569742c1f70a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c22ba85ca5120a51f401e44b","created_at":"2026-10-25T13:10:34.107Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-6031c91e78be4d9a","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-25T13:10:34.109Z","job_size_bytes":185,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c22ba85ca5120a51f401e44b: done: 0.141238 sec","job_status":"done","queue_duration_s":1.814923,"scheduling_latency_s":1.814937,"gitaly_calls":7,"gitaly_duration_s":0.041347,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.01436,"redis_read_bytes":501,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.001592,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000663,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002346,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.005566,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.004193,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000510959,"exclusive_lock_hold_duration_s":0.013837792,"duration_s":0.141238,"completed_at":"2026-10-25T13:10:36.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01516,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 245.571604] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:36.066Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8a2ef0779ca38ed33ef1961d","created_at":"2026-10-25T13:10:34.375Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-1ac9b01fba354255","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:34.396Z","job_size_bytes":46,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8a2ef0779ca38ed33ef1961d: start","job_status":"start","queue_duration_s":1.669912,"scheduling_latency_s":1.669928} gitlab # [ 245.572469] gitaly[900]: time="2026-10-25T13:10:36.006Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:46.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:36.002" grpc.time_ms=4.239 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.615288] gitaly[900]: time="2026-10-25T13:10:36.054Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-25T13:10:46.053" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:36.053" grpc.time_ms=0.71 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.615898] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:36.138Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8a2ef0779ca38ed33ef1961d","created_at":"2026-10-25T13:10:34.375Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-1ac9b01fba354255","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:34.396Z","job_size_bytes":46,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8a2ef0779ca38ed33ef1961d: done: 0.071906 sec","job_status":"done","queue_duration_s":1.669912,"scheduling_latency_s":1.669928,"gitaly_calls":2,"gitaly_duration_s":0.018045,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.004455,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000942,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000479,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00104,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001576,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000295848,"duration_s":0.071906,"completed_at":"2026-10-25T13:10:36.138Z","load_balancing_strategy":"primary","db_duration_s":0.007712,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 245.663928] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:36.140Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"3f25c838208b81cd550a0148","created_at":"2026-10-25T13:10:34.409Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-1ac9b01fba354255","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:34.413Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-3f25c838208b81cd550a0148: start","job_status":"start","queue_duration_s":1.726,"scheduling_latency_s":1.726025} gitlab # [ 245.664661] gitaly[900]: time="2026-10-25T13:10:36.096Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-25T19:10:36.091" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:36.091" grpc.time_ms=4.495 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.665454] gitaly[900]: time="2026-10-25T13:10:36.111Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-25T13:11:06.001" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:36.101" grpc.time_ms=10.041 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.716205] gitaly[900]: time="2026-10-25T13:10:36.255Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF diskcache=493eac89-cdca-4024-87a9-bde1c4e2b751 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-25T19:10:36.161" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:36.161" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.716957] gitaly[900]: time="2026-10-25T13:10:36.256Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1283 command.oublock=0 command.real_time_ms=91 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-25T19:10:36.161" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:36.161" grpc.time_ms=94.337 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.741420] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:36.280Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"3f25c838208b81cd550a0148","created_at":"2026-10-25T13:10:34.409Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-1ac9b01fba354255","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:34.413Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-3f25c838208b81cd550a0148: done: 0.141005 sec","job_status":"done","queue_duration_s":1.726,"scheduling_latency_s":1.726025,"gitaly_calls":1,"gitaly_duration_s":0.096244,"redis_calls":15,"redis_duration_s":0.003962,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002156,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000744,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12358973,"duration_s":0.141005,"completed_at":"2026-10-25T13:10:36.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.743470] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:36.282Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"c86fc13514b0968f9cbad137","created_at":"2026-10-25T13:10:34.523Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-1ac9b01fba354255","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:34.524Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-c86fc13514b0968f9cbad137: start","job_status":"start","queue_duration_s":1.757172,"scheduling_latency_s":1.757186} gitlab # [ 245.788071] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:36.308Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"c86fc13514b0968f9cbad137","created_at":"2026-10-25T13:10:34.523Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-1ac9b01fba354255","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:34.524Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-c86fc13514b0968f9cbad137: done: 0.026051 sec","job_status":"done","queue_duration_s":1.757172,"scheduling_latency_s":1.757186,"gitaly_calls":1,"gitaly_duration_s":0.00625,"redis_calls":16,"redis_duration_s":0.002094,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000165,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.000944,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026051,"completed_at":"2026-10-25T13:10:36.307Z","load_balancing_strategy":"primary","db_duration_s":0.001423,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 245.795986] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:36.308Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"305e80db3b9115e8b605ff62","created_at":"2026-10-25T13:10:34.962Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-1ac9b01fba354255","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a291034597b561a94e9835219ba078b51fba9dc205b8d67a9bb4b4c9c36dd284","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:34.965Z","job_size_bytes":467,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-305e80db3b9115e8b605ff62: start","job_status":"start","queue_duration_s":1.343285,"scheduling_latency_s":1.343299} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a' gitlab # [ 245.837610] gitaly[900]: time="2026-10-25T13:10:36.302Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=658 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-25T13:11:06.197" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:36.298" grpc.time_ms=4.77 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.838460] gitaly[900]: time="2026-10-25T13:10:36.324Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:06.223" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:36.323" grpc.time_ms=0.427 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.839099] gitaly[900]: time="2026-10-25T13:10:36.330Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-25T13:10:46.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:36.325" grpc.time_ms=4.984 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.864148] gitaly[900]: time="2026-10-25T13:10:36.403Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T13:11:06.302" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:36.403" grpc.time_ms=0.546 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.867794] gitaly[900]: time="2026-10-25T13:10:36.407Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=38 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-25T13:11:06.305" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:36.406" grpc.time_ms=1.434 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a', in 0.07 seconds) gitlab # [ 245.917271] nixbot[2655]: {"ts": "2026-10-25T13:10:36.456Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:54022 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a HTTP/1.1\" 200"} gitlab # [ 245.926510] gitaly[900]: time="2026-10-25T13:10:36.466Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:46.141" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:36.461" grpc.time_ms=4.568 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.362332] gitaly[900]: time="2026-10-25T13:10:36.901Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-25T13:11:06.784" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:36.885" grpc.time_ms=15.851 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.408393] gitaly[900]: time="2026-10-25T13:10:36.947Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJWYR298RZAHPB8XCHBVVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-25T13:11:06.837" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:36.937" grpc.time_ms=10.342 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.456108] sidekiq-cluster[2533]: {"severity":"WARN","time":"2026-10-25T13:10:36.995Z","class":"CreatePipelineWorker","correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"956eff33a93dfc78e6549841cc9fd4b4bc74aee8","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"956eff33a93dfc78e6549841cc9fd4b4bc74aee8","ref":"refs/heads/master"},"retry":0} gitlab # [ 246.476260] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.015Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"305e80db3b9115e8b605ff62","created_at":"2026-10-25T13:10:34.962Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-1ac9b01fba354255","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a291034597b561a94e9835219ba078b51fba9dc205b8d67a9bb4b4c9c36dd284","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:34.965Z","job_size_bytes":467,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-305e80db3b9115e8b605ff62: done: 0.706681 sec","job_status":"done","queue_duration_s":1.343285,"scheduling_latency_s":1.343299,"gitaly_calls":7,"gitaly_duration_s":0.120179,"redis_calls":51,"redis_duration_s":0.021905,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00065,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003237,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001452,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000743,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.552099,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000275175,"duration_s":0.706681,"completed_at":"2026-10-25T13:10:37.015Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036825,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 246.538762] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.077Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"ed790ac5-48b5-49ec-8c59-b61d9ea8f432\"}"],"class":"WebHookWorker","jid":"10b765ec8ba4c41c88963b11","created_at":"2026-10-25T13:10:35.107Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-1ac9b01fba354255","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:501eeec4f48a7980af53b17e8b1235a412193c904911d025689698b2d4969ec5","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.112Z","job_size_bytes":1751,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-10b765ec8ba4c41c88963b11: start","job_status":"start","queue_duration_s":1.965224,"scheduling_latency_s":1.965264} gitlab # [ 246.686982] nixbot[2655]: {"ts": "2026-10-25T13:10:37.226Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "5d691ee2-27d1-4676-a627-1105aaf662e6", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "956eff33a93dfc78e6549841cc9fd4b4bc74aee8", "pr": null} gitlab # [ 246.699254] nixbot[2655]: {"ts": "2026-10-25T13:10:37.238Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:54036 - \"POST /webhooks/gitlab HTTP/1.1\" 202"} gitlab # [ 246.721440] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.259Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"ed790ac5-48b5-49ec-8c59-b61d9ea8f432\"}"],"class":"WebHookWorker","jid":"10b765ec8ba4c41c88963b11","created_at":"2026-10-25T13:10:35.107Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-1ac9b01fba354255","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:501eeec4f48a7980af53b17e8b1235a412193c904911d025689698b2d4969ec5","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.112Z","job_size_bytes":1751,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-10b765ec8ba4c41c88963b11: done: 0.182382 sec","job_status":"done","queue_duration_s":1.965224,"scheduling_latency_s":1.965264,"redis_calls":19,"redis_duration_s":0.005097,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001285,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000413,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002238,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001161,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.07259134899999253,"cpu_s":0.08965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000574934,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.182382,"completed_at":"2026-10-25T13:10:37.259Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.768276] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.261Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a80bfb010fe77f92a595f547","created_at":"2026-10-25T13:10:35.584Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.587Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a80bfb010fe77f92a595f547: start","job_status":"start","queue_duration_s":1.674019,"scheduling_latency_s":1.674095} gitlab # [ 246.806084] gitaly[900]: time="2026-10-25T13:10:37.337Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYEEVJ9CTE7G46NCDXRDV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:37.332" grpc.time_ms=5.323 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 246.806867] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.342Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a80bfb010fe77f92a595f547","created_at":"2026-10-25T13:10:35.584Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.587Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a80bfb010fe77f92a595f547: done: 0.080627 sec","job_status":"done","queue_duration_s":1.674019,"scheduling_latency_s":1.674095,"redis_calls":10,"redis_duration_s":0.0053159999999999995,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000397,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000555,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257016,"duration_s":0.080627,"completed_at":"2026-10-25T13:10:37.342Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020284,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 246.845216] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.343Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a338907acf2704012b183d55","created_at":"2026-10-25T13:10:35.770Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.775Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a338907acf2704012b183d55: start","job_status":"start","queue_duration_s":1.567749,"scheduling_latency_s":1.567763} gitlab # [ 246.845924] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.364Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a338907acf2704012b183d55","created_at":"2026-10-25T13:10:35.770Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.775Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a338907acf2704012b183d55: done: 0.020743 sec","job_status":"done","queue_duration_s":1.567749,"scheduling_latency_s":1.567763,"redis_calls":10,"redis_duration_s":0.001318,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197231,"duration_s":0.020743,"completed_at":"2026-10-25T13:10:37.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002925,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a' gitlab # [ 246.888217] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.365Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a7559c63eb0d60ec18fbaa13","created_at":"2026-10-25T13:10:35.788Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.794Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a7559c63eb0d60ec18fbaa13: start","job_status":"start","queue_duration_s":1.57121,"scheduling_latency_s":1.571222} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a', in 0.02 seconds) gitlab # [ 246.888877] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.385Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a7559c63eb0d60ec18fbaa13","created_at":"2026-10-25T13:10:35.788Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.794Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a7559c63eb0d60ec18fbaa13: done: 0.019864 sec","job_status":"done","queue_duration_s":1.57121,"scheduling_latency_s":1.571222,"redis_calls":10,"redis_duration_s":0.001255,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193321,"duration_s":0.019864,"completed_at":"2026-10-25T13:10:37.385Z","load_balancing_strategy":"primary","db_duration_s":0.002679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.928535] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.386Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e0aa8deb87dfe9ed8f085511","created_at":"2026-10-25T13:10:35.808Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.813Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e0aa8deb87dfe9ed8f085511: start","job_status":"start","queue_duration_s":1.572397,"scheduling_latency_s":1.57241} gitlab # [ 246.966228] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 115 gitlab # [ 246.966816] gitlab-workhorse[825]: time="2026-10-25T13:10:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 246.967387] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 45 gitlab # [ 246.968127] nixbot[2655]: {"ts": "2026-10-25T13:10:37.481Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:54038 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a HTTP/1.1\" 200"} gitlab # [ 246.968528] gitaly[900]: time="2026-10-25T13:10:37.436Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYEJF132BR7Z6FW2847C8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:37.431" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 246.969067] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.410Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e0aa8deb87dfe9ed8f085511","created_at":"2026-10-25T13:10:35.808Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.813Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e0aa8deb87dfe9ed8f085511: done: 0.024301 sec","job_status":"done","queue_duration_s":1.572397,"scheduling_latency_s":1.57241,"redis_calls":13,"redis_duration_s":0.001929,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000449,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000398934,"duration_s":0.024301,"completed_at":"2026-10-25T13:10:37.410Z","load_balancing_strategy":"primary","db_duration_s":0.003961,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.012604] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.411Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0a9db18855a86072cdf4ef45","created_at":"2026-10-25T13:10:35.814Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.818Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0a9db18855a86072cdf4ef45: start","job_status":"start","queue_duration_s":1.592834,"scheduling_latency_s":1.592848} gitlab # [ 247.012976] gitaly[900]: time="2026-10-25T13:10:37.436Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYEJF132BR7Z6FW2847C8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:37.431" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.052552] gitlab-workhorse[825]: time="2026-10-25T13:10:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=337 gitlab # [ 247.053197] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 83 gitlab # [ 247.053636] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.433Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0a9db18855a86072cdf4ef45","created_at":"2026-10-25T13:10:35.814Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.818Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0a9db18855a86072cdf4ef45: done: 0.022117 sec","job_status":"done","queue_duration_s":1.592834,"scheduling_latency_s":1.592848,"redis_calls":10,"redis_duration_s":0.0012309999999999999,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000186616,"duration_s":0.022117,"completed_at":"2026-10-25T13:10:37.433Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.062871] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.435Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d4e63a590b1103207c38b582","created_at":"2026-10-25T13:10:35.819Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.823Z","job_size_bytes":19,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d4e63a590b1103207c38b582: start","job_status":"start","queue_duration_s":1.611705,"scheduling_latency_s":1.611719} gitlab # [ 247.104875] gitaly[900]: time="2026-10-25T13:10:37.437Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYEJF132BR7Z6FW2847C8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:37.431" grpc.time_ms=5.934 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.105554] nixbot[2655]: {"ts": "2026-10-25T13:10:37.562Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 247.106065] nixbot[2655]: {"ts": "2026-10-25T13:10:37.563Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "956eff33a93dfc78e6549841cc9fd4b4bc74aee8"} gitlab # [ 247.106543] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.464Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d4e63a590b1103207c38b582","created_at":"2026-10-25T13:10:35.819Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.823Z","job_size_bytes":19,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d4e63a590b1103207c38b582: done: 0.029142 sec","job_status":"done","queue_duration_s":1.611705,"scheduling_latency_s":1.611719,"redis_calls":11,"redis_duration_s":0.004173,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001867,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001629,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000677,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000228241,"duration_s":0.029142,"completed_at":"2026-10-25T13:10:37.464Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.145570] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.465Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2afb8a45e69e2de848a3c6a2","created_at":"2026-10-25T13:10:35.825Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.827Z","job_size_bytes":66,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2afb8a45e69e2de848a3c6a2: start","job_status":"start","queue_duration_s":1.637383,"scheduling_latency_s":1.637397} gitlab # [ 247.146419] gitaly[900]: time="2026-10-25T13:10:37.522Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYEKYB4QCNW2Z51D7D1G5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:37.512" pid=900 remote_ip="2001:db8:1::1" request_sha=db20d324bd3bd6d82d2c4eaf6f0e74d83538b890 response_bytes=337 span.kind=server system=grpc gitlab # [ 247.152185] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.565Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2afb8a45e69e2de848a3c6a2","created_at":"2026-10-25T13:10:35.825Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.827Z","job_size_bytes":66,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2afb8a45e69e2de848a3c6a2: done: 0.100459 sec","job_status":"done","queue_duration_s":1.637383,"scheduling_latency_s":1.637397,"redis_calls":10,"redis_duration_s":0.003615,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001933,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000365,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.075,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.072,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000358425,"duration_s":0.100459,"completed_at":"2026-10-25T13:10:37.565Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.076077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.198044] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.566Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"3b416ea71db270c9964d8e6f","created_at":"2026-10-25T13:10:35.828Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.831Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3b416ea71db270c9964d8e6f: start","job_status":"start","queue_duration_s":1.735742,"scheduling_latency_s":1.735778} gitlab # [ 247.238677] gitaly[900]: time="2026-10-25T13:10:37.522Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1197 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYEKYB4QCNW2Z51D7D1G5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:37.512" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.239466] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/956eff33a93dfc78e6549841cc9fd4b4bc74aee8 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 182 gitlab # [ 247.239932] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.591Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"3b416ea71db270c9964d8e6f","created_at":"2026-10-25T13:10:35.828Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.831Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3b416ea71db270c9964d8e6f: done: 0.025017 sec","job_status":"done","queue_duration_s":1.735742,"scheduling_latency_s":1.735778,"redis_calls":10,"redis_duration_s":0.00132,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000324,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214831,"duration_s":0.025017,"completed_at":"2026-10-25T13:10:37.591Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.282767] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.599Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"69b09163d4cf5cfd89e2935c","created_at":"2026-10-25T13:10:35.835Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.837Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-69b09163d4cf5cfd89e2935c: start","job_status":"start","queue_duration_s":1.761208,"scheduling_latency_s":1.761224} gitlab # [ 247.283676] gitaly[900]: time="2026-10-25T13:10:37.522Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1197 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYEKYB4QCNW2Z51D7D1G5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:37.512" grpc.time_ms=9.971 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.287766] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.629Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"69b09163d4cf5cfd89e2935c","created_at":"2026-10-25T13:10:35.835Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.837Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-69b09163d4cf5cfd89e2935c: done: 0.030696 sec","job_status":"done","queue_duration_s":1.761208,"scheduling_latency_s":1.761224,"redis_calls":10,"redis_duration_s":0.004684,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003055,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000327695,"duration_s":0.030696,"completed_at":"2026-10-25T13:10:37.629Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.364727] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.631Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"37e6d5ba000a02108b288b6a","created_at":"2026-10-25T13:10:35.838Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.840Z","job_size_bytes":6,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-37e6d5ba000a02108b288b6a: start","job_status":"start","queue_duration_s":1.790936,"scheduling_latency_s":1.79095} gitlab # [ 247.365900] gitaly[900]: time="2026-10-25T13:10:37.611Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYER4ZZPF6SYDC7K51497 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:07.610" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:37.610" grpc.time_ms=0.541 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.366688] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/956eff33a93dfc78e6549841cc9fd4b4bc74aee8 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 121 gitlab # [ 247.367872] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.647Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"37e6d5ba000a02108b288b6a","created_at":"2026-10-25T13:10:35.838Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.840Z","job_size_bytes":6,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-37e6d5ba000a02108b288b6a: done: 0.015337 sec","job_status":"done","queue_duration_s":1.790936,"scheduling_latency_s":1.79095,"redis_calls":10,"redis_duration_s":0.001516,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000331,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029501,"duration_s":0.015337,"completed_at":"2026-10-25T13:10:37.647Z","load_balancing_strategy":"primary","db_duration_s":0.002014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.430180] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.666Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"030939d21c58cd1a31ad4dca","created_at":"2026-10-25T13:10:35.841Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.843Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-030939d21c58cd1a31ad4dca: start","job_status":"start","queue_duration_s":1.822889,"scheduling_latency_s":1.822906} gitlab # [ 247.430862] gitaly[900]: time="2026-10-25T13:10:37.716Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYER4ZZPF6SYDC7K51497 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:47.050" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:37.710" grpc.time_ms=5.782 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.431495] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.726Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"030939d21c58cd1a31ad4dca","created_at":"2026-10-25T13:10:35.841Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.843Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-030939d21c58cd1a31ad4dca: done: 0.059675 sec","job_status":"done","queue_duration_s":1.822889,"scheduling_latency_s":1.822906,"redis_calls":10,"redis_duration_s":0.003287,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002176,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207568,"duration_s":0.059675,"completed_at":"2026-10-25T13:10:37.726Z","load_balancing_strategy":"primary","db_duration_s":0.037546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.459178] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.727Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"ff55f5e304251754c51fdeed","created_at":"2026-10-25T13:10:35.848Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.851Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-ff55f5e304251754c51fdeed: start","job_status":"start","queue_duration_s":1.876049,"scheduling_latency_s":1.876062} gitlab # [ 247.500920] gitaly[900]: time="2026-10-25T13:10:37.798Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYEXYWBC1A8J5AJMSFTGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:07.797" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:37.797" grpc.time_ms=0.424 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.502737] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/956eff33a93dfc78e6549841cc9fd4b4bc74aee8 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 144 gitlab # [ 247.503513] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.778Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"ff55f5e304251754c51fdeed","created_at":"2026-10-25T13:10:35.848Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.851Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-ff55f5e304251754c51fdeed: done: 0.051525 sec","job_status":"done","queue_duration_s":1.876049,"scheduling_latency_s":1.876062,"redis_calls":14,"redis_duration_s":0.00235,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000512635,"duration_s":0.051525,"completed_at":"2026-10-25T13:10:37.778Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.526941] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:37.783Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2aa5a172866e7cc6e07bffb3","created_at":"2026-10-25T13:10:35.917Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.918Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2aa5a172866e7cc6e07bffb3: start","job_status":"start","queue_duration_s":1.865332,"scheduling_latency_s":1.865347} gitlab # [ 247.569991] gitaly[900]: time="2026-10-25T13:10:37.844Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYEXYWBC1A8J5AJMSFTGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:47.263" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:37.833" grpc.time_ms=10.168 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.570672] gitaly[900]: time="2026-10-25T13:10:37.862Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:37.861" grpc.time_ms=0.284 pid=900 span.kind=server system=grpc gitlab # [ 247.571524] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 39 gitlab # [ 247.572618] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.038Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"71dae733b2ab5d19be807c5e","created_at":"2026-10-25T13:10:38.036Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"2aa5a172866e7cc6e07bffb3","job_size_bytes":3,"pid":2533,"job_status":"deduplicated","message":"PipelineProcessWorker JID-71dae733b2ab5d19be807c5e: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 247.578751] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.041Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2aa5a172866e7cc6e07bffb3","created_at":"2026-10-25T13:10:35.917Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.918Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2533,"job_status":"rescheduled","message":"PipelineProcessWorker JID-2aa5a172866e7cc6e07bffb3: rescheduled"} gitlab # [ 247.620675] gitaly[900]: time="2026-10-25T13:10:37.884Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:37.883" grpc.time_ms=0.858 pid=900 span.kind=server system=grpc gitlab # [ 247.621516] gitaly[900]: time="2026-10-25T13:10:37.902Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:37.901" grpc.time_ms=0.232 pid=900 span.kind=server system=grpc gitlab # [ 247.622221] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.046Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2aa5a172866e7cc6e07bffb3","created_at":"2026-10-25T13:10:35.917Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-89b85bc512284052","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.918Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2aa5a172866e7cc6e07bffb3: done: 0.262773 sec","job_status":"done","queue_duration_s":1.865332,"scheduling_latency_s":1.865347,"gitaly_calls":3,"gitaly_duration_s":0.125602,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009577,"redis_read_bytes":231,"redis_write_bytes":18466,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000311,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000659,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.001916,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12312,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.004786,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000151,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00034,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":18,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100879,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.207378312,"duration_s":0.262773,"completed_at":"2026-10-25T13:10:38.046Z","load_balancing_strategy":"primary","db_duration_s":0.029693,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.688721] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.047Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"14ed2b13ec17c44d532b9dd9","created_at":"2026-10-25T13:10:35.968Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-8cd6fe9d2f8641c9","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"3f25c838208b81cd550a0148","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.969Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-14ed2b13ec17c44d532b9dd9: start","job_status":"start","queue_duration_s":2.078182,"scheduling_latency_s":2.078201} gitlab # [ 247.689603] gitaly[900]: time="2026-10-25T13:10:37.912Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM diskcache=54547f15-9a9f-4b73-af97-927dfa1153e7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T13:11:07.727" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:37.828" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.690362] gitaly[900]: time="2026-10-25T13:10:37.947Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=63 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7159 command.oublock=0 command.real_time_ms=77 command.spawn_token_fork_ms=2 command.system_time_ms=43 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T13:11:07.727" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:37.828" grpc.time_ms=84.083 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.730197] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.084Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"14ed2b13ec17c44d532b9dd9","created_at":"2026-10-25T13:10:35.968Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-8cd6fe9d2f8641c9","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"3f25c838208b81cd550a0148","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:35.969Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-14ed2b13ec17c44d532b9dd9: done: 0.037075 sec","job_status":"done","queue_duration_s":2.078182,"scheduling_latency_s":2.078201,"gitaly_calls":1,"gitaly_duration_s":0.011327,"redis_calls":12,"redis_duration_s":0.002933,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000392,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.020712409,"duration_s":0.037075,"completed_at":"2026-10-25T13:10:38.084Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005973,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.732690] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.086Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1e50e49162569f51a42ca5dc","created_at":"2026-10-25T13:10:36.035Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-8cd6fe9d2f8641c9","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:046d3499edf9c30520ea135cc61bf6d66b5e468aa9eb70fbef68b01b0871ea69","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:36.036Z","job_size_bytes":467,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1e50e49162569f51a42ca5dc: start","job_status":"start","queue_duration_s":2.050314,"scheduling_latency_s":2.05033} gitlab # [ 247.775928] gitaly[900]: time="2026-10-25T13:10:37.953Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYF1WT2WKJ4KEQ57T80AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:07.052" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:37.952" grpc.time_ms=0.488 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.776575] gitlab-workhorse[825]: time="2026-10-25T13:10:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 247.777051] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 182 gitlab # [ 247.777491] gitaly[900]: time="2026-10-25T13:10:37.983Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T13:11:07.882" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:37.983" grpc.time_ms=0.364 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.778511] gitaly[900]: time="2026-10-25T13:10:37.990Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYF1WT2WKJ4KEQ57T80AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:47.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:37.977" grpc.time_ms=12.598 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.821644] gitaly[900]: time="2026-10-25T13:10:38.005Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:08.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:38.005" grpc.time_ms=0.59 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.822465] gitaly[900]: time="2026-10-25T13:10:38.073Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT diskcache=e1e8be30-4ad0-4c45-a4ed-6f361325d3f9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-25T19:10:38.063" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:38.064" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.823147] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 50 gitlab # [ 247.823555] gitaly[900]: time="2026-10-25T13:10:38.075Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-25T19:10:38.063" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:38.064" grpc.time_ms=9.414 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.830140] gitaly[900]: time="2026-10-25T13:10:38.093Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYF7616YW58QRV9C8KXWT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.086" grpc.time_ms=6.82 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.833085] gitaly[900]: time="2026-10-25T13:10:38.104Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:08.103" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:38.103" grpc.time_ms=0.496 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.872530] gitaly[900]: time="2026-10-25T13:10:38.112Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-25T13:10:48.105" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:38.105" grpc.time_ms=6.559 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.873291] gitlab-workhorse[825]: time="2026-10-25T13:10:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 247.873704] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 43 gitlab # [ 247.874367] gitaly[900]: time="2026-10-25T13:10:38.159Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T13:11:08.158" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:38.158" grpc.time_ms=0.549 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.880047] gitaly[900]: time="2026-10-25T13:10:38.197Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYF8ED9A2XM4V09WTWF9D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.127" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 247.880757] gitaly[900]: time="2026-10-25T13:10:38.277Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=68 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYF8ED9A2XM4V09WTWF9D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.127" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a' gitlab # [ 247.927790] gitaly[900]: time="2026-10-25T13:10:38.200Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=325 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-25T13:11:08.197" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:38.197" grpc.time_ms=3.236 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.928660] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 37 gitlab # [ 247.929174] gitaly[900]: time="2026-10-25T13:10:38.277Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=68 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYF8ED9A2XM4V09WTWF9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.127" grpc.time_ms=149.883 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.929752] gitaly[900]: time="2026-10-25T13:10:38.310Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=5 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:48.298" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:38.298" grpc.time_ms=11.396 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.930720] gitaly[900]: time="2026-10-25T13:10:38.351Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYFEW0FT4BTF3PSFQN2ZV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.344" grpc.time_ms=6.942 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.968528] gitaly[900]: time="2026-10-25T13:10:38.396Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYFGHYS1KR9Z9C69EDXSE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.390" pid=900 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a', in 0.05 seconds) gitlab # [ 247.969444] gitaly[900]: time="2026-10-25T13:10:38.396Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYFGHYS1KR9Z9C69EDXSE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.390" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.970155] gitaly[900]: time="2026-10-25T13:10:38.397Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYFGHYS1KR9Z9C69EDXSE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.390" grpc.time_ms=6.387 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.974541] gitaly[900]: time="2026-10-25T13:10:38.457Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYFJN7NAAFXG9VSPEY61F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.451" grpc.time_ms=6.029 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.986928] gitaly[900]: time="2026-10-25T13:10:38.522Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYFKVATSPP7CSH7REY5P9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.505" pid=900 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc gitlab # [ 247.995970] gitlab-workhorse[825]: time="2026-10-25T13:10:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=221 gitlab # [ 247.997191] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 63 gitlab # [ 247.999192] nixbot[2655]: {"ts": "2026-10-25T13:10:38.530Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:54042 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a HTTP/1.1\" 200"} gitlab # [ 248.001679] gitaly[900]: time="2026-10-25T13:10:38.522Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYFKVATSPP7CSH7REY5P9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.505" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 248.044131] gitaly[900]: time="2026-10-25T13:10:38.522Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYFKVATSPP7CSH7REY5P9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.505" grpc.time_ms=17.261 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 248.186469] gitaly[900]: time="2026-10-25T13:10:38.726Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-25T13:11:08.708" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:38.709" grpc.time_ms=16.932 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.202806] gitaly[900]: time="2026-10-25T13:10:38.742Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYATWD5TCZD9R6TKNN7ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-25T13:11:08.729" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:38.730" grpc.time_ms=12.175 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.210977] sidekiq-cluster[2533]: {"severity":"WARN","time":"2026-10-25T13:10:38.750Z","class":"CreatePipelineWorker","correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"956eff33a93dfc78e6549841cc9fd4b4bc74aee8","after":"47f294322ca552a961eaddfd759c569742c1f70a","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"47f294322ca552a961eaddfd759c569742c1f70a","ref":"refs/heads/master"},"retry":0} gitlab # [ 248.214954] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.754Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1e50e49162569f51a42ca5dc","created_at":"2026-10-25T13:10:36.035Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-8cd6fe9d2f8641c9","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:046d3499edf9c30520ea135cc61bf6d66b5e468aa9eb70fbef68b01b0871ea69","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:36.036Z","job_size_bytes":467,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1e50e49162569f51a42ca5dc: done: 0.6676 sec","job_status":"done","queue_duration_s":2.050314,"scheduling_latency_s":2.05033,"gitaly_calls":7,"gitaly_duration_s":0.176169,"redis_calls":33,"redis_duration_s":0.0044540000000000005,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.00037,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002455,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000697,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.417196,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.6676,"completed_at":"2026-10-25T13:10:38.754Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041169,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.263959] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.755Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"c55ec0af-2c69-4d67-980a-1b61366a44ac\"}"],"class":"WebHookWorker","jid":"ee9cd49353201d5fda0f401e","created_at":"2026-10-25T13:10:36.045Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-8cd6fe9d2f8641c9","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a9a92fe46ad55df2ce5f4c0a2790b40daae86ee2bc97d0338a83939149980d74","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:36.046Z","job_size_bytes":1749,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-ee9cd49353201d5fda0f401e: start","job_status":"start","queue_duration_s":2.709039,"scheduling_latency_s":2.709054} gitlab # [ 248.264605] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.782Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"c55ec0af-2c69-4d67-980a-1b61366a44ac\"}"],"class":"WebHookWorker","jid":"ee9cd49353201d5fda0f401e","created_at":"2026-10-25T13:10:36.045Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-8cd6fe9d2f8641c9","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a9a92fe46ad55df2ce5f4c0a2790b40daae86ee2bc97d0338a83939149980d74","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:36.046Z","job_size_bytes":1749,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-ee9cd49353201d5fda0f401e: done: 0.026865 sec","job_status":"done","queue_duration_s":2.709039,"scheduling_latency_s":2.709054,"redis_calls":14,"redis_duration_s":0.002496,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000372,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.005295925000012858,"cpu_s":0.015958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.026865,"completed_at":"2026-10-25T13:10:38.782Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.324229] nixbot[2655]: {"ts": "2026-10-25T13:10:38.772Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "87e60ad8-3c5d-4697-a6a4-968b9b3eaf8f", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "47f294322ca552a961eaddfd759c569742c1f70a", "pr": null} gitlab # [ 248.324832] nixbot[2655]: {"ts": "2026-10-25T13:10:38.774Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:54048 - \"POST /webhooks/gitlab HTTP/1.1\" 202"} gitlab # [ 248.325765] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 46 gitlab # [ 248.326557] gitaly[900]: time="2026-10-25T13:10:38.839Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYFY9YB5J3ZVX1KKR99ZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.834" grpc.time_ms=5 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 248.327417] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.783Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"3d334306b046508395a2ac25","created_at":"2026-10-25T13:10:36.121Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-7477926f2ef040e2","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:36.126Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-3d334306b046508395a2ac25: start","job_status":"start","queue_duration_s":2.657154,"scheduling_latency_s":2.657173} gitlab # [ 248.336609] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.838Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"3d334306b046508395a2ac25","created_at":"2026-10-25T13:10:36.121Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-7477926f2ef040e2","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:36.126Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-3d334306b046508395a2ac25: done: 0.055084 sec","job_status":"done","queue_duration_s":2.657154,"scheduling_latency_s":2.657173,"redis_calls":19,"redis_duration_s":0.0036550000000000003,"redis_read_bytes":22,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000817,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000432,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001815,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0070073159999999995,"duration_s":0.055084,"completed_at":"2026-10-25T13:10:38.838Z","load_balancing_strategy":"primary","db_duration_s":0.009519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.412186] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.840Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","10b765ec8ba4c41c88963b11"],"class":"WebHooks::LogExecutionWorker","jid":"161a8a74d5f0346853ba7df2","created_at":"2026-10-25T13:10:37.243Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-52ca3f866b714377","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:28facd49332f7f750e44f9f6fd454d6d55f9b1e6fe55c32a1a4b1b8b08d83117","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.250Z","job_size_bytes":2593,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-161a8a74d5f0346853ba7df2: start","job_status":"start","queue_duration_s":1.589427,"scheduling_latency_s":1.589442} gitlab # [ 248.412880] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.869Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","10b765ec8ba4c41c88963b11"],"class":"WebHooks::LogExecutionWorker","jid":"161a8a74d5f0346853ba7df2","created_at":"2026-10-25T13:10:37.243Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-52ca3f866b714377","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:28facd49332f7f750e44f9f6fd454d6d55f9b1e6fe55c32a1a4b1b8b08d83117","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.250Z","job_size_bytes":2593,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-161a8a74d5f0346853ba7df2: done: 0.028875 sec","job_status":"done","queue_duration_s":1.589427,"scheduling_latency_s":1.589442,"redis_calls":10,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000304508,"duration_s":0.028875,"completed_at":"2026-10-25T13:10:38.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004971,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.469559] gitlab-workhorse[825]: time="2026-10-25T13:10:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 248.470213] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 39 gitlab # [ 248.470974] gitaly[900]: time="2026-10-25T13:10:38.880Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYFZS9F807ZVX1GK6JESF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.873" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 248.471680] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.870Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4e91042723bc8cc40774ce1f","created_at":"2026-10-25T13:10:37.822Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.824Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4e91042723bc8cc40774ce1f: start","job_status":"start","queue_duration_s":1.045911,"scheduling_latency_s":1.045923} gitlab # [ 248.472196] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4e91042723bc8cc40774ce1f","created_at":"2026-10-25T13:10:37.822Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.824Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4e91042723bc8cc40774ce1f: done: 0.026365 sec","job_status":"done","queue_duration_s":1.045911,"scheduling_latency_s":1.045923,"redis_calls":7,"redis_duration_s":0.001229,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026365,"completed_at":"2026-10-25T13:10:38.896Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005551,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.522890] gitaly[900]: time="2026-10-25T13:10:38.880Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYFZS9F807ZVX1GK6JESF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.873" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 248.523539] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.897Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7d96dc1db7a41454b6b233d3","created_at":"2026-10-25T13:10:37.951Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.953Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7d96dc1db7a41454b6b233d3: start","job_status":"start","queue_duration_s":0.943608,"scheduling_latency_s":0.943622} gitlab # [ 248.526862] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.912Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7d96dc1db7a41454b6b233d3","created_at":"2026-10-25T13:10:37.951Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.953Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7d96dc1db7a41454b6b233d3: done: 0.015437 sec","job_status":"done","queue_duration_s":0.943608,"scheduling_latency_s":0.943622,"redis_calls":7,"redis_duration_s":0.000864,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015437,"completed_at":"2026-10-25T13:10:38.912Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.593591] gitaly[900]: time="2026-10-25T13:10:38.880Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYFZS9F807ZVX1GK6JESF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T13:10:38.873" grpc.time_ms=7.107 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 248.594547] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.913Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"42a9b8463d65be979ee8d2f0","created_at":"2026-10-25T13:10:37.958Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.960Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-42a9b8463d65be979ee8d2f0: start","job_status":"start","queue_duration_s":0.953547,"scheduling_latency_s":0.953561} gitlab # [ 248.595059] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.933Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"42a9b8463d65be979ee8d2f0","created_at":"2026-10-25T13:10:37.958Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.960Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-42a9b8463d65be979ee8d2f0: done: 0.019332 sec","job_status":"done","queue_duration_s":0.953547,"scheduling_latency_s":0.953561,"redis_calls":7,"redis_duration_s":0.001067,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019332,"completed_at":"2026-10-25T13:10:38.933Z","load_balancing_strategy":"primary","db_duration_s":0.004029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.646041] gitaly[900]: time="2026-10-25T13:10:38.978Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:08.077" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:38.977" grpc.time_ms=0.663 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.646845] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.934Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3c1584eaf2bc0c1c4abaa330","created_at":"2026-10-25T13:10:37.964Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.965Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3c1584eaf2bc0c1c4abaa330: start","job_status":"start","queue_duration_s":0.968244,"scheduling_latency_s":0.968264} gitlab # [ 248.658033] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.958Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3c1584eaf2bc0c1c4abaa330","created_at":"2026-10-25T13:10:37.964Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.965Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3c1584eaf2bc0c1c4abaa330: done: 0.024391 sec","job_status":"done","queue_duration_s":0.968244,"scheduling_latency_s":0.968264,"redis_calls":10,"redis_duration_s":0.004626999999999999,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003931,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000374,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024391,"completed_at":"2026-10-25T13:10:38.958Z","load_balancing_strategy":"primary","db_duration_s":0.003151,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.727119] gitaly[900]: time="2026-10-25T13:10:38.990Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-25T13:11:08.083" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:38.984" grpc.time_ms=5.93 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.727715] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.959Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5fc121dba0ab9831a9da989d","created_at":"2026-10-25T13:10:37.966Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.967Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5fc121dba0ab9831a9da989d: start","job_status":"start","queue_duration_s":0.992271,"scheduling_latency_s":0.992288} gitlab # [ 248.728512] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.979Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5fc121dba0ab9831a9da989d","created_at":"2026-10-25T13:10:37.966Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.967Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5fc121dba0ab9831a9da989d: done: 0.019927 sec","job_status":"done","queue_duration_s":0.992271,"scheduling_latency_s":0.992288,"redis_calls":7,"redis_duration_s":0.001027,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019927,"completed_at":"2026-10-25T13:10:38.979Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.773834] gitaly[900]: time="2026-10-25T13:10:38.999Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:48.024" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:38.994" grpc.time_ms=4.958 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.775092] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.981Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"5f6bf7894bab00f475e721b1","created_at":"2026-10-25T13:10:37.967Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.969Z","job_size_bytes":19,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-5f6bf7894bab00f475e721b1: start","job_status":"start","queue_duration_s":1.011631,"scheduling_latency_s":1.01165} gitlab # [ 248.814659] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:38.999Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"5f6bf7894bab00f475e721b1","created_at":"2026-10-25T13:10:37.967Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.969Z","job_size_bytes":19,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-5f6bf7894bab00f475e721b1: done: 0.018395 sec","job_status":"done","queue_duration_s":1.011631,"scheduling_latency_s":1.01165,"redis_calls":8,"redis_duration_s":0.001605,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001341,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018395,"completed_at":"2026-10-25T13:10:38.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.859775] gitaly[900]: time="2026-10-25T13:10:39.019Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-25T13:10:49.019" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:39.019" grpc.time_ms=0.194 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.860581] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.001Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"383aa09e08d333bf8bc0036e","created_at":"2026-10-25T13:10:37.970Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.971Z","job_size_bytes":66,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-383aa09e08d333bf8bc0036e: start","job_status":"start","queue_duration_s":1.029841,"scheduling_latency_s":1.029859} gitlab # [ 248.861202] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.019Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"383aa09e08d333bf8bc0036e","created_at":"2026-10-25T13:10:37.970Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.971Z","job_size_bytes":66,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-383aa09e08d333bf8bc0036e: done: 0.018017 sec","job_status":"done","queue_duration_s":1.029841,"scheduling_latency_s":1.029859,"redis_calls":7,"redis_duration_s":0.0011589999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018017,"completed_at":"2026-10-25T13:10:39.019Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002771,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.905713] gitaly[900]: time="2026-10-25T13:10:39.028Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-25T13:10:49.022" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:39.022" grpc.time_ms=5.604 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.906392] gitaly[900]: time="2026-10-25T13:10:39.054Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:39.054" grpc.time_ms=0.253 pid=900 span.kind=server system=grpc gitlab # [ 248.911737] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.020Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"53e1f5172e3a2d56cb235179","created_at":"2026-10-25T13:10:37.971Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.972Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-53e1f5172e3a2d56cb235179: start","job_status":"start","queue_duration_s":1.048258,"scheduling_latency_s":1.048275} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a' gitlab # [ 248.951570] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.038Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"53e1f5172e3a2d56cb235179","created_at":"2026-10-25T13:10:37.971Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.972Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-53e1f5172e3a2d56cb235179: done: 0.018247 sec","job_status":"done","queue_duration_s":1.048258,"scheduling_latency_s":1.048275,"redis_calls":7,"redis_duration_s":0.001081,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018247,"completed_at":"2026-10-25T13:10:39.038Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.999283] gitaly[900]: time="2026-10-25T13:10:39.129Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:39.128" grpc.time_ms=0.722 pid=900 span.kind=server system=grpc gitlab # [ 248.999886] gitaly[900]: time="2026-10-25T13:10:39.145Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:39.144" grpc.time_ms=0.323 pid=900 span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a', in 0.04 seconds) (finished: subtest: push delivers the webhook, in 47.62 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses gitlab # [ 249.000368] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.040Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fe1844c76ba11ad467355c47","created_at":"2026-10-25T13:10:37.972Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.973Z","job_size_bytes":6,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fe1844c76ba11ad467355c47: start","job_status":"start","queue_duration_s":1.066385,"scheduling_latency_s":1.066398} gitlab # [ 249.000965] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.049Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fe1844c76ba11ad467355c47","created_at":"2026-10-25T13:10:37.972Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.973Z","job_size_bytes":6,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fe1844c76ba11ad467355c47: done: 0.009036 sec","job_status":"done","queue_duration_s":1.066385,"scheduling_latency_s":1.066398,"redis_calls":7,"redis_duration_s":0.001051,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009036,"completed_at":"2026-10-25T13:10:39.049Z","load_balancing_strategy":"primary","db_duration_s":0.000283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.053400] gitaly[900]: time="2026-10-25T13:10:39.162Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:39.162" grpc.time_ms=0.279 pid=900 span.kind=server system=grpc gitlab # [ 249.054071] gitaly[900]: time="2026-10-25T13:10:39.171Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM diskcache=8e108f6f-4b09-4b40-866f-0a8a1a772cc2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T13:11:09.108" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:39.109" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.054984] nixbot[2655]: {"ts": "2026-10-25T13:10:39.569Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:54062 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=47f294322ca552a961eaddfd759c569742c1f70a HTTP/1.1\" 200"} gitlab # [ 249.055688] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.050Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0ddc4a16c16817b57e24425e","created_at":"2026-10-25T13:10:37.974Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.974Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0ddc4a16c16817b57e24425e: start","job_status":"start","queue_duration_s":1.075176,"scheduling_latency_s":1.075189} gitlab # [ 249.067627] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.065Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0ddc4a16c16817b57e24425e","created_at":"2026-10-25T13:10:37.974Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:37.974Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0ddc4a16c16817b57e24425e: done: 0.015149 sec","job_status":"done","queue_duration_s":1.075176,"scheduling_latency_s":1.075189,"redis_calls":7,"redis_duration_s":0.00098,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015149,"completed_at":"2026-10-25T13:10:39.065Z","load_balancing_strategy":"primary","db_duration_s":0.002795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.120779] gitaly[900]: time="2026-10-25T13:10:39.172Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=63 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7250 command.oublock=0 command.real_time_ms=55 command.spawn_token_fork_ms=0 command.system_time_ms=41 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T13:11:09.108" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:39.109" grpc.time_ms=62.731 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses, in 0.14 seconds) gitlab # [ 249.121613] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.066Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"9c4dd2ddd6af5dde2de740f7","created_at":"2026-10-25T13:10:38.041Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:38.043Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9c4dd2ddd6af5dde2de740f7: start","job_status":"start","queue_duration_s":1.022896,"scheduling_latency_s":1.022909} gitlab # [ 249.161866] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.284Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"9c4dd2ddd6af5dde2de740f7","created_at":"2026-10-25T13:10:38.041Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-a17b0ff02ffb48d0","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:38.043Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9c4dd2ddd6af5dde2de740f7: done: 0.218388 sec","job_status":"done","queue_duration_s":1.022896,"scheduling_latency_s":1.022909,"gitaly_calls":3,"gitaly_duration_s":0.06881,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007957,"redis_read_bytes":143,"redis_write_bytes":16714,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000351,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000648,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001853,"redis_queues_read_bytes":23,"redis_queues_write_bytes":11220,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.00278,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000183,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000749,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121449,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.197763403,"duration_s":0.218388,"completed_at":"2026-10-25T13:10:39.284Z","load_balancing_strategy":"primary","db_duration_s":0.02187,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.206697] gitaly[900]: time="2026-10-25T13:10:39.253Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T13:11:09.252" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:39.252" grpc.time_ms=0.667 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.207842] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 120 gitlab # [ 249.208500] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.285Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","ee9cd49353201d5fda0f401e"],"class":"WebHooks::LogExecutionWorker","jid":"581281cc863ede3fc15c0da1","created_at":"2026-10-25T13:10:38.775Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-49177e71c7e54b9b","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9e92cf0bed024192a430c5742ae06edf777e06f229475e52d8202d1164deae2e","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:38.778Z","job_size_bytes":2592,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-581281cc863ede3fc15c0da1: start","job_status":"start","queue_duration_s":0.507476,"scheduling_latency_s":0.507494} gitlab # [ 249.209131] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.301Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","ee9cd49353201d5fda0f401e"],"class":"WebHooks::LogExecutionWorker","jid":"581281cc863ede3fc15c0da1","created_at":"2026-10-25T13:10:38.775Z","trace_propagation_headers":{"sentry-trace":"f7324f1095e8439486980a2f1749cfb3-49177e71c7e54b9b","baggage":"sentry-trace_id=f7324f1095e8439486980a2f1749cfb3,sentry-release=Unknown"},"correlation_id":"01M5SJYATWD5TCZD9R6TKNN7ZT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9e92cf0bed024192a430c5742ae06edf777e06f229475e52d8202d1164deae2e","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:38.778Z","job_size_bytes":2592,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-581281cc863ede3fc15c0da1: done: 0.016478 sec","job_status":"done","queue_duration_s":0.507476,"scheduling_latency_s":0.507494,"redis_calls":7,"redis_duration_s":0.000871,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000224,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016478,"completed_at":"2026-10-25T13:10:39.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.242623] gitaly[900]: time="2026-10-25T13:10:39.276Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJX2Y650CEESSWQS6J57DM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:09.275" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:39.275" grpc.time_ms=0.409 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.253787] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.303Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"adc5eb13d1903cc6c434ca1f","created_at":"2026-10-25T13:10:38.828Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-acd592382d114060","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:38.833Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-adc5eb13d1903cc6c434ca1f: start","job_status":"start","queue_duration_s":0.470162,"scheduling_latency_s":0.470202} gitlab # [ 249.296119] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.357Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"adc5eb13d1903cc6c434ca1f","created_at":"2026-10-25T13:10:38.828Z","trace_propagation_headers":{"sentry-trace":"5d8015db85154eca890239278a9b096e-acd592382d114060","baggage":"sentry-trace_id=5d8015db85154eca890239278a9b096e,sentry-release=Unknown"},"correlation_id":"01M5SJWYR298RZAHPB8XCHBVVF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:38.833Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-adc5eb13d1903cc6c434ca1f: done: 0.054194 sec","job_status":"done","queue_duration_s":0.470162,"scheduling_latency_s":0.470202,"redis_calls":11,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000219,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217626,"duration_s":0.054194,"completed_at":"2026-10-25T13:10:39.357Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.341810] gitaly[900]: time="2026-10-25T13:10:39.686Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYGQ08WWXKQWNENN1VRR6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:09.685" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:39.686" grpc.time_ms=0.417 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.342726] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.358Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e2de829f47fa873e229e6864","created_at":"2026-10-25T13:10:39.102Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.104Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e2de829f47fa873e229e6864: start","job_status":"start","queue_duration_s":0.254161,"scheduling_latency_s":0.254175} gitlab # [ 249.343535] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.382Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e2de829f47fa873e229e6864","created_at":"2026-10-25T13:10:39.102Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.104Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e2de829f47fa873e229e6864: done: 0.024075 sec","job_status":"done","queue_duration_s":0.254161,"scheduling_latency_s":0.254175,"redis_calls":7,"redis_duration_s":0.000928,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024075,"completed_at":"2026-10-25T13:10:39.382Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004418,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.383707] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.383Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"56f4659efe37716eaad18c7f","created_at":"2026-10-25T13:10:39.176Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.178Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-56f4659efe37716eaad18c7f: start","job_status":"start","queue_duration_s":0.205105,"scheduling_latency_s":0.20512} gitlab # [ 249.387964] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.398Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"56f4659efe37716eaad18c7f","created_at":"2026-10-25T13:10:39.176Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.178Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-56f4659efe37716eaad18c7f: done: 0.015192 sec","job_status":"done","queue_duration_s":0.205105,"scheduling_latency_s":0.20512,"redis_calls":7,"redis_duration_s":0.0008810000000000001,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015192,"completed_at":"2026-10-25T13:10:39.398Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.458705] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.399Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7dd72941b73e3dc3bd18053d","created_at":"2026-10-25T13:10:39.183Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.228Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-7dd72941b73e3dc3bd18053d: start","job_status":"start","queue_duration_s":0.17123,"scheduling_latency_s":0.171243} gitlab # [ 249.459375] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.415Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7dd72941b73e3dc3bd18053d","created_at":"2026-10-25T13:10:39.183Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.228Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-7dd72941b73e3dc3bd18053d: done: 0.016005 sec","job_status":"done","queue_duration_s":0.17123,"scheduling_latency_s":0.171243,"redis_calls":7,"redis_duration_s":0.000895,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016005,"completed_at":"2026-10-25T13:10:39.415Z","load_balancing_strategy":"primary","db_duration_s":0.003038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.478935] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.416Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"92d87dc6c784ea10c620aa9a","created_at":"2026-10-25T13:10:39.234Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.235Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-92d87dc6c784ea10c620aa9a: start","job_status":"start","queue_duration_s":0.180662,"scheduling_latency_s":0.180676} gitlab # [ 249.492879] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.437Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"92d87dc6c784ea10c620aa9a","created_at":"2026-10-25T13:10:39.234Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.235Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-92d87dc6c784ea10c620aa9a: done: 0.021042 sec","job_status":"done","queue_duration_s":0.180662,"scheduling_latency_s":0.180676,"redis_calls":10,"redis_duration_s":0.001657,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000419,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021042,"completed_at":"2026-10-25T13:10:39.437Z","load_balancing_strategy":"primary","db_duration_s":0.002676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.540214] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.438Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"96cc2410fa13fa13d5dafd44","created_at":"2026-10-25T13:10:39.235Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.236Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-96cc2410fa13fa13d5dafd44: start","job_status":"start","queue_duration_s":0.201534,"scheduling_latency_s":0.201551} gitlab # [ 249.546593] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.454Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"96cc2410fa13fa13d5dafd44","created_at":"2026-10-25T13:10:39.235Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.236Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-96cc2410fa13fa13d5dafd44: done: 0.015696 sec","job_status":"done","queue_duration_s":0.201534,"scheduling_latency_s":0.201551,"redis_calls":7,"redis_duration_s":0.000901,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015696,"completed_at":"2026-10-25T13:10:39.454Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002309,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.596527] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.454Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c6f8b078be3a220f5819058e","created_at":"2026-10-25T13:10:39.237Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.239Z","job_size_bytes":19,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c6f8b078be3a220f5819058e: start","job_status":"start","queue_duration_s":0.215348,"scheduling_latency_s":0.215363} gitlab # [ 249.599911] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c6f8b078be3a220f5819058e","created_at":"2026-10-25T13:10:39.237Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.239Z","job_size_bytes":19,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c6f8b078be3a220f5819058e: done: 0.01503 sec","job_status":"done","queue_duration_s":0.215348,"scheduling_latency_s":0.215363,"redis_calls":8,"redis_duration_s":0.001085,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01503,"completed_at":"2026-10-25T13:10:39.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002027,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.642260] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.470Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ab99c10d53b02911237a3df8","created_at":"2026-10-25T13:10:39.240Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.241Z","job_size_bytes":66,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ab99c10d53b02911237a3df8: start","job_status":"start","queue_duration_s":0.229348,"scheduling_latency_s":0.229362} gitlab # [ 249.653057] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.483Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ab99c10d53b02911237a3df8","created_at":"2026-10-25T13:10:39.240Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.241Z","job_size_bytes":66,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ab99c10d53b02911237a3df8: done: 0.012977 sec","job_status":"done","queue_duration_s":0.229348,"scheduling_latency_s":0.229362,"redis_calls":7,"redis_duration_s":0.000864,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012977,"completed_at":"2026-10-25T13:10:39.483Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.704065] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.484Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"0fdf3fe19398457c9e7bade7","created_at":"2026-10-25T13:10:39.241Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.242Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0fdf3fe19398457c9e7bade7: start","job_status":"start","queue_duration_s":0.241958,"scheduling_latency_s":0.241971} gitlab # [ 249.705650] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.500Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"0fdf3fe19398457c9e7bade7","created_at":"2026-10-25T13:10:39.241Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.242Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0fdf3fe19398457c9e7bade7: done: 0.015735 sec","job_status":"done","queue_duration_s":0.241958,"scheduling_latency_s":0.241971,"redis_calls":7,"redis_duration_s":0.00089,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015735,"completed_at":"2026-10-25T13:10:39.500Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.744100] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.501Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"19dbeba2d24a88d7b5f01250","created_at":"2026-10-25T13:10:39.242Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.243Z","job_size_bytes":6,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-19dbeba2d24a88d7b5f01250: start","job_status":"start","queue_duration_s":0.257431,"scheduling_latency_s":0.257444} gitlab # [ 249.785362] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.509Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"19dbeba2d24a88d7b5f01250","created_at":"2026-10-25T13:10:39.242Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.243Z","job_size_bytes":6,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-19dbeba2d24a88d7b5f01250: done: 0.008145 sec","job_status":"done","queue_duration_s":0.257431,"scheduling_latency_s":0.257444,"redis_calls":7,"redis_duration_s":0.00085,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008145,"completed_at":"2026-10-25T13:10:39.509Z","load_balancing_strategy":"primary","db_duration_s":0.000232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.795521] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.510Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ac3d1d7328353885515ddfa3","created_at":"2026-10-25T13:10:39.244Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.244Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ac3d1d7328353885515ddfa3: start","job_status":"start","queue_duration_s":0.265311,"scheduling_latency_s":0.265323} gitlab # [ 249.837732] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:39.523Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ac3d1d7328353885515ddfa3","created_at":"2026-10-25T13:10:39.244Z","trace_propagation_headers":{"sentry-trace":"ac6135e925d448b68b812f24863d4e8e-58c74c7748e9482f","baggage":"sentry-trace_id=ac6135e925d448b68b812f24863d4e8e,sentry-release=Unknown"},"correlation_id":"01M5SJX2Y650CEESSWQS6J57DM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:39.244Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ac3d1d7328353885515ddfa3: done: 0.013048 sec","job_status":"done","queue_duration_s":0.265311,"scheduling_latency_s":0.265323,"redis_calls":7,"redis_duration_s":0.000899,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013048,"completed_at":"2026-10-25T13:10:39.523Z","load_balancing_strategy":"primary","db_duration_s":0.00189,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.891825] gitaly[900]: time="2026-10-25T13:10:40.431Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:40.430" grpc.time_ms=0.315 pid=900 span.kind=server system=grpc gitlab # [ 249.902435] gitaly[900]: time="2026-10-25T13:10:40.442Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T13:10:49.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:39.030" operations="[repack_refs]" pid=900 ref=refs/keep-around/47f294322ca552a961eaddfd759c569742c1f70a remote_ip="2001:db8:1::1" revision=47f294322ca552a961eaddfd759c569742c1f70a span.kind=server system=grpc username=root gitlab # [ 249.903483] gitaly[900]: time="2026-10-25T13:10:40.443Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T13:10:49.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:39.030" pid=900 ref=refs/keep-around/47f294322ca552a961eaddfd759c569742c1f70a remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-25 13:09:41.852382194 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" revision=47f294322ca552a961eaddfd759c569742c1f70a span.kind=server system=grpc username=root gitlab # [ 249.907994] gitaly[900]: time="2026-10-25T13:10:40.447Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 diskcache=4d51ecc0-8326-4139-bb60-7251dd3bc742 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T13:10:49.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:39.030" pid=900 ref=refs/keep-around/47f294322ca552a961eaddfd759c569742c1f70a remote_ip="2001:db8:1::1" revision=47f294322ca552a961eaddfd759c569742c1f70a span.kind=server system=grpc username=root gitlab # [ 249.908623] gitaly[900]: time="2026-10-25T13:10:40.447Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=131 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=856064 command.minflt=5602 command.oublock=8 command.real_time_ms=1412 command.spawn_token_fork_ms=0 command.system_time_ms=114 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T13:10:49.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:39.030" grpc.time_ms=1417.147 pid=900 ref=refs/keep-around/47f294322ca552a961eaddfd759c569742c1f70a remote_ip="2001:db8:1::1" revision=47f294322ca552a961eaddfd759c569742c1f70a span.kind=server system=grpc username=root gitlab # [ 249.911784] gitaly[900]: time="2026-10-25T13:10:40.451Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:10.451" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:40.451" grpc.time_ms=0.21 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.953836] gitaly[900]: time="2026-10-25T13:10:40.456Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T13:10:49.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:39.030" pid=900 ref=refs/keep-around/47f294322ca552a961eaddfd759c569742c1f70a remote_ip="2001:db8:1::1" revision=47f294322ca552a961eaddfd759c569742c1f70a span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 249.954641] gitaly[900]: time="2026-10-25T13:10:40.456Z" level=info msg="optimized repository" clean_stale_data_time=12.606351ms clean_work_trees_time="67.327µs" commit_graph_time="3.631µs" correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=900 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.19µs" storage_name=default system=housekeeping total_time=12.779557ms gitlab # [ 249.955393] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:40.458Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"852c8e8a1eb0ec915a0dcad2","created_at":"2026-10-25T13:10:40.455Z","trace_propagation_headers":{"sentry-trace":"950447e0dd1642dd8bfcfe67ee352b55-2dd78dfa8efd4297","baggage":"sentry-trace_id=950447e0dd1642dd8bfcfe67ee352b55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYG2XK73TCJN1RNC52DS8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:40.457Z","job_size_bytes":65,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-852c8e8a1eb0ec915a0dcad2: start","job_status":"start","queue_duration_s":0.000999,"scheduling_latency_s":0.001028} gitlab # [ 249.956097] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:40.479Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"852c8e8a1eb0ec915a0dcad2","created_at":"2026-10-25T13:10:40.455Z","trace_propagation_headers":{"sentry-trace":"950447e0dd1642dd8bfcfe67ee352b55-2dd78dfa8efd4297","baggage":"sentry-trace_id=950447e0dd1642dd8bfcfe67ee352b55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYG2XK73TCJN1RNC52DS8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:40.457Z","job_size_bytes":65,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-852c8e8a1eb0ec915a0dcad2: done: 0.020583 sec","job_status":"done","queue_duration_s":0.000999,"scheduling_latency_s":0.001028,"redis_calls":7,"redis_duration_s":0.000884,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020583,"completed_at":"2026-10-25T13:10:40.479Z","load_balancing_strategy":"primary","db_duration_s":0.00312,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 250.000338] gitaly[900]: time="2026-10-25T13:10:40.456Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T13:10:49.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T13:10:39.030" pid=900 ref=refs/keep-around/47f294322ca552a961eaddfd759c569742c1f70a remote_ip="2001:db8:1::1" revision=47f294322ca552a961eaddfd759c569742c1f70a span.kind=server system=grpc username=root gitlab # [ 250.000952] nixbot[2655]: {"ts": "2026-10-25T13:10:40.513Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-47f294322ca5-6"} gitlab # [ 250.002722] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/47f294322ca552a961eaddfd759c569742c1f70a HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 1561 gitlab # [ 250.005103] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:40.480Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0c75c46b98392c27bb036e80","created_at":"2026-10-25T13:10:40.458Z","trace_propagation_headers":{"sentry-trace":"950447e0dd1642dd8bfcfe67ee352b55-2dd78dfa8efd4297","baggage":"sentry-trace_id=950447e0dd1642dd8bfcfe67ee352b55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYG2XK73TCJN1RNC52DS8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:40.459Z","job_size_bytes":65,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0c75c46b98392c27bb036e80: start","job_status":"start","queue_duration_s":0.020526,"scheduling_latency_s":0.020542} gitlab # [ 250.020700] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:40.514Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0c75c46b98392c27bb036e80","created_at":"2026-10-25T13:10:40.458Z","trace_propagation_headers":{"sentry-trace":"950447e0dd1642dd8bfcfe67ee352b55-2dd78dfa8efd4297","baggage":"sentry-trace_id=950447e0dd1642dd8bfcfe67ee352b55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYG2XK73TCJN1RNC52DS8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:40.459Z","job_size_bytes":65,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0c75c46b98392c27bb036e80: done: 0.034139 sec","job_status":"done","queue_duration_s":0.020526,"scheduling_latency_s":0.020542,"redis_calls":10,"redis_duration_s":0.001289,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000606,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034139,"completed_at":"2026-10-25T13:10:40.514Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.076786] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:40.515Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7a60863bc5001f44197df6f1","created_at":"2026-10-25T13:10:40.491Z","trace_propagation_headers":{"sentry-trace":"950447e0dd1642dd8bfcfe67ee352b55-2dd78dfa8efd4297","baggage":"sentry-trace_id=950447e0dd1642dd8bfcfe67ee352b55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYG2XK73TCJN1RNC52DS8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:40.493Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7a60863bc5001f44197df6f1: start","job_status":"start","queue_duration_s":0.02185,"scheduling_latency_s":0.021866} gitlab # [ 250.077585] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:40.601Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7a60863bc5001f44197df6f1","created_at":"2026-10-25T13:10:40.491Z","trace_propagation_headers":{"sentry-trace":"950447e0dd1642dd8bfcfe67ee352b55-2dd78dfa8efd4297","baggage":"sentry-trace_id=950447e0dd1642dd8bfcfe67ee352b55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYG2XK73TCJN1RNC52DS8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:40.493Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7a60863bc5001f44197df6f1: done: 0.086034 sec","job_status":"done","queue_duration_s":0.02185,"scheduling_latency_s":0.021866,"gitaly_calls":2,"gitaly_duration_s":0.005637,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.01081,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.003688,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000659,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000527,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000162,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000252,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055448,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06654896,"duration_s":0.086034,"completed_at":"2026-10-25T13:10:40.601Z","load_balancing_strategy":"primary","db_duration_s":0.020176,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 250.148468] nixbot[2655]: {"ts": "2026-10-25T13:10:40.603Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-47f294322ca5-6", "argv0": "bwrap"} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses gitlab # [ 250.149224] gitaly[900]: time="2026-10-25T13:10:40.571Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T13:11:10.569" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:40.569" grpc.time_ms=1.311 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.149788] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:40.602Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"82976fae5eda99d59dd6f96c","created_at":"2026-10-25T13:10:40.557Z","trace_propagation_headers":{"sentry-trace":"950447e0dd1642dd8bfcfe67ee352b55-a30a31ae35e84fd1","baggage":"sentry-trace_id=950447e0dd1642dd8bfcfe67ee352b55,sentry-release=Unknown"},"correlation_id":"01M5SJYG2XK73TCJN1RNC52DS8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:40.559Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-82976fae5eda99d59dd6f96c: start","job_status":"start","queue_duration_s":0.043109,"scheduling_latency_s":0.043125} gitlab # [ 250.150436] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:40.628Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"82976fae5eda99d59dd6f96c","created_at":"2026-10-25T13:10:40.557Z","trace_propagation_headers":{"sentry-trace":"950447e0dd1642dd8bfcfe67ee352b55-a30a31ae35e84fd1","baggage":"sentry-trace_id=950447e0dd1642dd8bfcfe67ee352b55,sentry-release=Unknown"},"correlation_id":"01M5SJYG2XK73TCJN1RNC52DS8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:40.559Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-82976fae5eda99d59dd6f96c: done: 0.026002 sec","job_status":"done","queue_duration_s":0.043109,"scheduling_latency_s":0.043125,"redis_calls":7,"redis_duration_s":0.005186,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004456,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00073,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026002,"completed_at":"2026-10-25T13:10:40.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.191276] gitaly[900]: time="2026-10-25T13:10:40.594Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYG2XK73TCJN1RNC52DS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:10.593" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:40.593" grpc.time_ms=0.417 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.241652] gitaly[900]: time="2026-10-25T13:10:40.781Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYHVC1RSQKFMBGTFF60MG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:10.780" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:40.780" grpc.time_ms=0.388 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.271379] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 61 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses, in 0.10 seconds) gitlab # [ 250.298031] nix-daemon[2816]: accepted connection from pid 3693, user nixbot gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses gitlab # [ 251.400084] gitaly[900]: time="2026-10-25T13:10:41.939Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYJXQHF0CZ8DG6MV55Q3D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:11.037" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:41.937" grpc.time_ms=0.868 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.427677] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 118 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses, in 0.16 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses gitlab # [ 252.542843] gitaly[900]: time="2026-10-25T13:10:43.081Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYM1XGFQS4X9FWXTRH6EZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:13.080" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:43.080" grpc.time_ms=0.895 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 252.571462] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 104 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses, in 0.14 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses gitlab # [ 253.670934] gitaly[900]: time="2026-10-25T13:10:44.210Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYN5MX04550DDF15A6NS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:14.205" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:44.206" grpc.time_ms=3.544 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses, in 0.18 seconds) gitlab # [ 253.739566] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 129 gitlab # [ 254.569811] nix-daemon[2816]: accepted connection from pid 3724, user nixbot gitlab # [ 254.594777] nix-daemon[2816]: accepted connection from pid 3693, user nixbot gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses gitlab # [ 254.753518] gitaly[900]: time="2026-10-25T13:10:45.292Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:15.290" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:45.290" grpc.time_ms=1.34 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.830818] gitaly[900]: time="2026-10-25T13:10:45.370Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:55.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:45.356" grpc.time_ms=14.117 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.858479] gitaly[900]: time="2026-10-25T13:10:45.398Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYPB28RA1HQNNSWDBGYZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:15.396" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:45.397" grpc.time_ms=0.761 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.879386] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.418Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4e2fc04f2988d943a4813270","created_at":"2026-10-25T13:10:45.412Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-b94048d645e3495e","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.416Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4e2fc04f2988d943a4813270: start","job_status":"start","queue_duration_s":0.001631,"scheduling_latency_s":0.001667} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses, in 0.15 seconds) gitlab # [ 254.902788] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 80 gitlab # [ 254.905888] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/47f294322ca552a961eaddfd759c569742c1f70a HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 205 gitlab # [ 254.952171] gitaly[900]: time="2026-10-25T13:10:45.491Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYPE1DE37XQZYAKCVJQMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:15.490" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:45.491" grpc.time_ms=0.5 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.983746] gitaly[900]: time="2026-10-25T13:10:45.523Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:45.522" grpc.time_ms=0.465 pid=900 span.kind=server system=grpc gitlab # [ 254.993394] gitaly[900]: time="2026-10-25T13:10:45.526Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYPE1DE37XQZYAKCVJQMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:55.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:45.519" grpc.time_ms=7.199 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.021947] gitaly[900]: time="2026-10-25T13:10:45.561Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:45.560" grpc.time_ms=0.305 pid=900 span.kind=server system=grpc gitlab # [ 255.031191] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/47f294322ca552a961eaddfd759c569742c1f70a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 122 gitlab # [ 255.048945] gitaly[900]: time="2026-10-25T13:10:45.588Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:45.588" grpc.time_ms=0.266 pid=900 span.kind=server system=grpc gitlab # [ 255.085060] gitaly[900]: time="2026-10-25T13:10:45.624Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYPJJKRTRYMYKB2SBFCN7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:15.623" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:45.624" grpc.time_ms=0.482 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.109531] gitaly[900]: time="2026-10-25T13:10:45.649Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYPJJKRTRYMYKB2SBFCN7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T13:10:55.133" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:45.643" grpc.time_ms=5.596 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.172742] gitaly[900]: time="2026-10-25T13:10:45.712Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X diskcache=af73f8dc-1c3c-4cf9-8688-fa6d4049992c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T13:11:15.503" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:45.503" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.173565] gitaly[900]: time="2026-10-25T13:10:45.712Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=78 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7497 command.oublock=0 command.real_time_ms=94 command.spawn_token_fork_ms=0 command.system_time_ms=53 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T13:11:15.503" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:45.503" grpc.time_ms=208.695 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.185563] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/47f294322ca552a961eaddfd759c569742c1f70a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 138 gitlab # [ 255.217638] gitaly[900]: time="2026-10-25T13:10:45.757Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T13:11:15.756" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:45.756" grpc.time_ms=0.842 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.250708] gitaly[900]: time="2026-10-25T13:10:45.790Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:15.787" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:45.789" grpc.time_ms=0.49 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.258200] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.797Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"30eb5db4529810cf9f785b11","created_at":"2026-10-25T13:10:45.796Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"4e2fc04f2988d943a4813270","job_size_bytes":3,"pid":2533,"job_status":"deduplicated","message":"PipelineProcessWorker JID-30eb5db4529810cf9f785b11: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 255.259167] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.798Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4e2fc04f2988d943a4813270","created_at":"2026-10-25T13:10:45.412Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-b94048d645e3495e","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.416Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2533,"job_status":"rescheduled","message":"PipelineProcessWorker JID-4e2fc04f2988d943a4813270: rescheduled"} gitlab # [ 255.263382] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.802Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4e2fc04f2988d943a4813270","created_at":"2026-10-25T13:10:45.412Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-b94048d645e3495e","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.416Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4e2fc04f2988d943a4813270: done: 0.384663 sec","job_status":"done","queue_duration_s":0.001631,"scheduling_latency_s":0.001667,"gitaly_calls":3,"gitaly_duration_s":0.227906,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.017951,"redis_read_bytes":239,"redis_write_bytes":21783,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000779,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00226,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002925,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.005628,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.0003,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002001,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003279,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105753,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.339241439,"duration_s":0.384663,"completed_at":"2026-10-25T13:10:45.802Z","load_balancing_strategy":"primary","db_duration_s":0.034981,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.315047] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.803Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9bd049d9a37af19d38d3c795","created_at":"2026-10-25T13:10:45.495Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.497Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9bd049d9a37af19d38d3c795: start","job_status":"start","queue_duration_s":0.306557,"scheduling_latency_s":0.306573} gitlab # [ 255.315631] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.827Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9bd049d9a37af19d38d3c795","created_at":"2026-10-25T13:10:45.495Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.497Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9bd049d9a37af19d38d3c795: done: 0.024107 sec","job_status":"done","queue_duration_s":0.306557,"scheduling_latency_s":0.306573,"redis_calls":7,"redis_duration_s":0.000866,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024107,"completed_at":"2026-10-25T13:10:45.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00403,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.367662] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.828Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a008b7f816659b8404f3ef32","created_at":"2026-10-25T13:10:45.716Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.719Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a008b7f816659b8404f3ef32: start","job_status":"start","queue_duration_s":0.109691,"scheduling_latency_s":0.109706} gitlab # [ 255.368452] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.844Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a008b7f816659b8404f3ef32","created_at":"2026-10-25T13:10:45.716Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.719Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a008b7f816659b8404f3ef32: done: 0.01527 sec","job_status":"done","queue_duration_s":0.109691,"scheduling_latency_s":0.109706,"redis_calls":7,"redis_duration_s":0.000807,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000215,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01527,"completed_at":"2026-10-25T13:10:45.844Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.409205] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.844Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c9aff55d016aac7baec78a7e","created_at":"2026-10-25T13:10:45.723Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.727Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c9aff55d016aac7baec78a7e: start","job_status":"start","queue_duration_s":0.117118,"scheduling_latency_s":0.117161} gitlab # [ 255.447646] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.860Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c9aff55d016aac7baec78a7e","created_at":"2026-10-25T13:10:45.723Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.727Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c9aff55d016aac7baec78a7e: done: 0.015736 sec","job_status":"done","queue_duration_s":0.117118,"scheduling_latency_s":0.117161,"redis_calls":7,"redis_duration_s":0.0008359999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000597,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015736,"completed_at":"2026-10-25T13:10:45.860Z","load_balancing_strategy":"primary","db_duration_s":0.002427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.448594] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.861Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"53a7c4d18ad23c52835791bd","created_at":"2026-10-25T13:10:45.735Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.737Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-53a7c4d18ad23c52835791bd: start","job_status":"start","queue_duration_s":0.124066,"scheduling_latency_s":0.124079} gitlab # [ 255.491113] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.878Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"53a7c4d18ad23c52835791bd","created_at":"2026-10-25T13:10:45.735Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.737Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-53a7c4d18ad23c52835791bd: done: 0.017366 sec","job_status":"done","queue_duration_s":0.124066,"scheduling_latency_s":0.124079,"redis_calls":10,"redis_duration_s":0.001157,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000349,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000214,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017366,"completed_at":"2026-10-25T13:10:45.878Z","load_balancing_strategy":"primary","db_duration_s":0.002383,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.500998] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.879Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"99cacfbcb836dc4686a0a556","created_at":"2026-10-25T13:10:45.737Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.739Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-99cacfbcb836dc4686a0a556: start","job_status":"start","queue_duration_s":0.140461,"scheduling_latency_s":0.140483} gitlab # [ 255.515737] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.894Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"99cacfbcb836dc4686a0a556","created_at":"2026-10-25T13:10:45.737Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.739Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-99cacfbcb836dc4686a0a556: done: 0.014545 sec","job_status":"done","queue_duration_s":0.140461,"scheduling_latency_s":0.140483,"redis_calls":7,"redis_duration_s":0.000857,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000213,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014545,"completed_at":"2026-10-25T13:10:45.894Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.577754] gitaly[900]: time="2026-10-25T13:10:46.038Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:46.037" grpc.time_ms=0.268 pid=900 span.kind=server system=grpc gitlab # [ 255.578538] gitaly[900]: time="2026-10-25T13:10:46.062Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:46.062" grpc.time_ms=0.313 pid=900 span.kind=server system=grpc gitlab # [ 255.579088] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.895Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f824f4ecdd13014d0d228035","created_at":"2026-10-25T13:10:45.739Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.740Z","job_size_bytes":19,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f824f4ecdd13014d0d228035: start","job_status":"start","queue_duration_s":0.154278,"scheduling_latency_s":0.154291} gitlab # [ 255.587583] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.908Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f824f4ecdd13014d0d228035","created_at":"2026-10-25T13:10:45.739Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.740Z","job_size_bytes":19,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f824f4ecdd13014d0d228035: done: 0.013773 sec","job_status":"done","queue_duration_s":0.154278,"scheduling_latency_s":0.154291,"redis_calls":8,"redis_duration_s":0.000968,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013773,"completed_at":"2026-10-25T13:10:45.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.654694] gitaly[900]: time="2026-10-25T13:10:46.079Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T13:10:46.078" grpc.time_ms=0.276 pid=900 span.kind=server system=grpc gitlab # [ 255.655515] gitaly[900]: time="2026-10-25T13:10:46.087Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X diskcache=3546250c-e798-445c-a9f4-4230174d707b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T13:11:16.020" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:46.020" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.656058] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.909Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c4ea546ddb6822e7ac392137","created_at":"2026-10-25T13:10:45.741Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.742Z","job_size_bytes":66,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c4ea546ddb6822e7ac392137: start","job_status":"start","queue_duration_s":0.166972,"scheduling_latency_s":0.166986} gitlab # [ 255.657707] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.922Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c4ea546ddb6822e7ac392137","created_at":"2026-10-25T13:10:45.741Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.742Z","job_size_bytes":66,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c4ea546ddb6822e7ac392137: done: 0.012808 sec","job_status":"done","queue_duration_s":0.166972,"scheduling_latency_s":0.166986,"redis_calls":7,"redis_duration_s":0.000793,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000217,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012808,"completed_at":"2026-10-25T13:10:45.922Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.704093] gitaly[900]: time="2026-10-25T13:10:46.087Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=64 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7200 command.oublock=0 command.real_time_ms=61 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T13:11:16.020" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T13:10:46.020" grpc.time_ms=67.115 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.707558] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.923Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"97d3c1a34a4f3ae7b3422c01","created_at":"2026-10-25T13:10:45.743Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.744Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-97d3c1a34a4f3ae7b3422c01: start","job_status":"start","queue_duration_s":0.179166,"scheduling_latency_s":0.179179} gitlab # [ 255.754636] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"97d3c1a34a4f3ae7b3422c01","created_at":"2026-10-25T13:10:45.743Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.744Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-97d3c1a34a4f3ae7b3422c01: done: 0.018936 sec","job_status":"done","queue_duration_s":0.179166,"scheduling_latency_s":0.179179,"redis_calls":7,"redis_duration_s":0.000864,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018936,"completed_at":"2026-10-25T13:10:45.942Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.759525] gitaly[900]: time="2026-10-25T13:10:46.119Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T13:11:16.118" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:46.119" grpc.time_ms=0.578 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.770081] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.943Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"490a5444abe7469f1a844151","created_at":"2026-10-25T13:10:45.746Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.747Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-490a5444abe7469f1a844151: start","job_status":"start","queue_duration_s":0.195832,"scheduling_latency_s":0.195846} gitlab # [ 255.814450] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.957Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"490a5444abe7469f1a844151","created_at":"2026-10-25T13:10:45.746Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.747Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-490a5444abe7469f1a844151: done: 0.014766 sec","job_status":"done","queue_duration_s":0.195832,"scheduling_latency_s":0.195846,"redis_calls":7,"redis_duration_s":0.0008359999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000218,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014766,"completed_at":"2026-10-25T13:10:45.957Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.855949] gitaly[900]: time="2026-10-25T13:10:46.217Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYP7BDGYQ6SRD57TV458X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:16.216" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:46.217" grpc.time_ms=0.507 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.856745] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.958Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9bff3882f0af0e418e1c5ae7","created_at":"2026-10-25T13:10:45.747Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.748Z","job_size_bytes":6,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9bff3882f0af0e418e1c5ae7: start","job_status":"start","queue_duration_s":0.210298,"scheduling_latency_s":0.210312} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses gitlab # [ 255.857385] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.967Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9bff3882f0af0e418e1c5ae7","created_at":"2026-10-25T13:10:45.747Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.748Z","job_size_bytes":6,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9bff3882f0af0e418e1c5ae7: done: 0.008244 sec","job_status":"done","queue_duration_s":0.210298,"scheduling_latency_s":0.210312,"redis_calls":7,"redis_duration_s":0.000815,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000215,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008244,"completed_at":"2026-10-25T13:10:45.967Z","load_balancing_strategy":"primary","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.904093] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.967Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"d98056f05668e880371c6030","created_at":"2026-10-25T13:10:45.748Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.749Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d98056f05668e880371c6030: start","job_status":"start","queue_duration_s":0.218198,"scheduling_latency_s":0.218211} gitlab # [ 255.904752] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.981Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"d98056f05668e880371c6030","created_at":"2026-10-25T13:10:45.748Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.749Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d98056f05668e880371c6030: done: 0.013255 sec","job_status":"done","queue_duration_s":0.218198,"scheduling_latency_s":0.218211,"redis_calls":7,"redis_duration_s":0.001031,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000216,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013255,"completed_at":"2026-10-25T13:10:45.981Z","load_balancing_strategy":"primary","db_duration_s":0.001728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.945675] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:45.981Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"1927be7f4f30a6f128ade269","created_at":"2026-10-25T13:10:45.799Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.799Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1927be7f4f30a6f128ade269: start","job_status":"start","queue_duration_s":0.182066,"scheduling_latency_s":0.182111} gitlab # [ 255.946531] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:46.227Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"1927be7f4f30a6f128ade269","created_at":"2026-10-25T13:10:45.799Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-5cf0422d87ca405d","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:45.799Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1927be7f4f30a6f128ade269: done: 0.245459 sec","job_status":"done","queue_duration_s":0.182066,"scheduling_latency_s":0.182111,"gitaly_calls":3,"gitaly_duration_s":0.148898,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006982,"redis_read_bytes":144,"redis_write_bytes":16875,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000279,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000887,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":20,"redis_queues_duration_s":0.001528,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11224,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.002339,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000163,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000539,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075448,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.225483127,"duration_s":0.245459,"completed_at":"2026-10-25T13:10:46.227Z","load_balancing_strategy":"primary","db_duration_s":0.01902,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.990633] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:46.228Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"be830cd7462063cfc10eeb96","created_at":"2026-10-25T13:10:46.015Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-c3df3da9cfe84253","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:46.016Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-be830cd7462063cfc10eeb96: start","job_status":"start","queue_duration_s":0.211661,"scheduling_latency_s":0.211675} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/47f294322ca552a961eaddfd759c569742c1f70a/statuses, in 0.17 seconds) (finished: subtest: eval and build post commit statuses, in 7.04 seconds) (finished: run the VM test script, in 308.38 seconds) gitlab # [ 256.005471] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:46.259Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"be830cd7462063cfc10eeb96","created_at":"2026-10-25T13:10:46.015Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-c3df3da9cfe84253","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:46.016Z","job_size_bytes":23,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-be830cd7462063cfc10eeb96: done: 0.03095 sec","job_status":"done","queue_duration_s":0.211661,"scheduling_latency_s":0.211675,"redis_calls":7,"redis_duration_s":0.000971,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03095,"completed_at":"2026-10-25T13:10:46.259Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009899,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 256.059806] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:46.260Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"26fccedc6ccf9965f01ba84a","created_at":"2026-10-25T13:10:46.091Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-c3df3da9cfe84253","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:46.093Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-26fccedc6ccf9965f01ba84a: start","job_status":"start","queue_duration_s":0.167269,"scheduling_latency_s":0.167284} gitlab # [ 256.060637] sidekiq-cluster[2533]: {"severity":"INFO","time":"2026-10-25T13:10:46.277Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"26fccedc6ccf9965f01ba84a","created_at":"2026-10-25T13:10:46.091Z","trace_propagation_headers":{"sentry-trace":"561f8c1659b74f4fa96251840d407769-c3df3da9cfe84253","baggage":"sentry-trace_id=561f8c1659b74f4fa96251840d407769,sentry-release=Unknown"},"correlation_id":"01M5SJYP7BDGYQ6SRD57TV458X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-25T13:10:46.093Z","job_size_bytes":3,"pid":2533,"sidekiq_tid":"m7xt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-26fccedc6ccf9965f01ba84a: done: 0.01709 sec","job_status":"done","queue_duration_s":0.167269,"scheduling_latency_s":0.167284,"redis_calls":7,"redis_duration_s":0.001029,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01709,"completed_at":"2026-10-25T13:10:46.277Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} test script finished in 308.45s cleanup gitlab # [ 256.134600] gitaly[900]: time="2026-10-25T13:10:46.592Z" level=info msg="finished unary call with code OK" catfile.duration_ms=44 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=44 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SJYQE03DAHXWSQXR3286MT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T13:11:16.548" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T13:10:46.548" grpc.time_ms=44.333 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root kill QemuMachine (pid 46) gitlab # [ 256.136361] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/25:13:10:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repoqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) gitlab # s (finished: cleanup, in 1.65 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-25T13:09:51.604Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '47f294322ca552a961eaddfd759c569742c1f70a', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-25T13:10:38.936187Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}] [] [{'id': 5, 'sha': '47f294322ca552a961eaddfd759c569742c1f70a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-25T13:10:40.487Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '47f294322ca552a961eaddfd759c569742c1f70a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-25T13:10:40.487Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '47f294322ca552a961eaddfd759c569742c1f70a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-25T13:10:40.487Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '47f294322ca552a961eaddfd759c569742c1f70a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-25T13:10:40.487Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '47f294322ca552a961eaddfd759c569742c1f70a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-25T13:10:40.487Z', 'started_at': None, 'finished_at': '2026-10-25T13:10:45.402Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '47f294322ca552a961eaddfd759c569742c1f70a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-25T13:10:40.487Z', 'started_at': None, 'finished_at': '2026-10-25T13:10:45.402Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '47f294322ca552a961eaddfd759c569742c1f70a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-25T13:10:45.545Z', 'started_at': None, 'finished_at': '2026-10-25T13:10:45.675Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]