tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.1hP6dUXvNT', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab # Discarding device blocks: 0/262144 done gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes (finished: start all VMs, in 48.12 seconds) gitlab # Filesystem UUID: 95d97819-c1cc-42e2-8273-c6b26cf67210 gitlab: waiting for unit setup-gitlab.service gitlab # Superblock backups stored on blocks: gitlab: waiting for the VM to finish booting gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5d6gba0gcd87p7hv97lrikhzxsxqvh2v-nixos-system-gitlab-test/init regInfo=/nix/store/d2sizigrsxx6cfmm06f0f5qmnyk4pln7-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 455522585 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.010 MHz processor gitlab # [ 0.000812] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000880] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002738] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002749] Using GB pages for direct mapping gitlab # [ 0.002917] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002923] ACPI: Early table checksum verification disabled gitlab # [ 0.002926] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002930] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002934] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002940] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002942] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002943] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002945] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002946] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002948] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002949] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002949] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002950] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002950] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002951] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003164] No NUMA configuration found gitlab # [ 0.003165] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003168] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff] gitlab # [ 0.005298] Zone ranges: gitlab # [ 0.005299] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005300] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005301] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005302] Device empty gitlab # [ 0.005303] Movable zone start for each node gitlab # [ 0.005303] Early memory node ranges gitlab # [ 0.005304] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005305] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005306] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005307] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005325] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.005584] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.109046] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.109475] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.109490] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.109524] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.109527] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.109528] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.109529] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.109530] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.109531] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.109534] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.109535] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.109540] TSC deadline timer available gitlab # [ 0.109544] CPU topo: Max. logical packages: 1 gitlab # [ 0.109545] CPU topo: Max. logical dies: 1 gitlab # [ 0.109545] CPU topo: Max. dies per package: 1 gitlab # [ 0.109549] CPU topo: Max. threads per core: 1 gitlab # [ 0.109550] CPU topo: Num. cores per package: 4 gitlab # [ 0.109550] CPU topo: Num. threads per package: 4 gitlab # [ 0.109551] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.109574] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.109591] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.109593] kvm-guest: setup PV sched yield gitlab # [ 0.109609] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.109610] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.109611] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.109613] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.109614] Booting paravirtualized kernel on KVM gitlab # [ 0.109618] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.114076] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.116209] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.116262] kvm-guest: PV spinlocks enabled gitlab # [ 0.116264] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.116267] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5d6gba0gcd87p7hv97lrikhzxsxqvh2v-nixos-system-gitlab-test/init regInfo=/nix/store/d2sizigrsxx6cfmm06f0f5qmnyk4pln7-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.116369] Unknown kernel command line parameters "regInfo=/nix/store/d2sizigrsxx6cfmm06f0f5qmnyk4pln7-closure-info/registration", will be passed to user space. gitlab # [ 0.116382] random: crng init done gitlab # [ 0.116383] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.124884] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.129240] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.129313] software IO TLB: area num 4. gitlab # [ 0.200643] Fallback order for Node 0: 0 gitlab # [ 0.200651] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.200653] Policy zone: Normal gitlab # [ 0.203052] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.212575] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.225694] allocated 12582912 bytes of page_ext gitlab # [ 0.235587] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.235589] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.236452] Dynamic Preempt: lazy gitlab # [ 0.236627] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.236628] rcu: RCU event tracing is enabled. gitlab # [ 0.236629] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.236630] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.236631] Rude variant of Tasks RCU enabled. gitlab # [ 0.236631] Tracing variant of Tasks RCU enabled. gitlab # [ 0.236632] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.236633] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.236652] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.236654] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.236655] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.240969] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.241260] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.241270] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.241391] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.244945] Console: colour VGA+ 80x25 gitlab # [ 0.244948] printk: legacy console [tty0] enabled gitlab # [ 0.275170] printk: legacy console [ttyS0] enabled gitlab # [ 0.383765] ACPI: Core revision 20250807 gitlab # [ 0.384756] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.386385] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.387466] x2apic enabled gitlab # [ 0.388208] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.389143] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.390420] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.391906] kvm-guest: setup PV IPIs gitlab # [ 0.393508] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.394575] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns gitlab # [ 0.396354] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010) gitlab # [ 0.398434] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.399464] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.401346] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.402350] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.403346] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.404347] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.406136] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.407104] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.408153] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.409354] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.410347] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.411346] active return thunk: srso_alias_return_thunk gitlab # [ 0.412368] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.413346] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.415179] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.416346] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.417346] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.418346] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.419346] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.420346] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.422144] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.423133] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.424140] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.425133] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.426150] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.456002] Freeing SMP alternatives memory: 44K gitlab # [ 0.456349] pid_max: default: 32768 minimum: 301 gitlab # [ 0.457460] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.458449] landlock: Up and running. gitlab # [ 0.459347] Yama: becoming mindful. gitlab # [ 0.460547] LSM support for eBPF active gitlab # [ 0.461449] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.462479] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.465442] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.466929] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.467356] ... version: 2 gitlab # [ 0.468128] ... bit width: 48 gitlab # [ 0.468348] ... generic counters: 6 gitlab # [ 0.469091] ... generic bitmap: 000000000000003f gitlab # [ 0.469348] ... fixed-purpose counters: 0 gitlab # [ 0.470122] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.470348] ... value mask: 0000ffffffffffff gitlab # [ 0.471300] ... max period: 00007fffffffffff gitlab # [ 0.472107] ... global_ctrl mask: 000000000000003f gitlab # [ 0.472465] signal: max sigframe size: 3376 gitlab # [ 0.473290] rcu: Hierarchical SRCU implementation. gitlab # [ 0.474009] rcu: Max phase no-delay instances is 400. gitlab # [ 0.474538] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.479908] smp: Bringing up secondary CPUs ... gitlab # [ 0.480988] smpboot: x86: Booting SMP configuration: gitlab # [ 0.481352] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.484549] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.486064] smpboot: Total of 4 processors activated (19200.08 BogoMIPS) gitlab # [ 0.486693] Memory: 6011576K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved) gitlab # [ 0.488349] devtmpfs: initialized gitlab # [ 0.489171] x86/mm: Memory block size: 128MB gitlab # [ 0.492441] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.493420] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.494441] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.495644] PM: RTC time: 14:18:42, date: 2026-10-26 gitlab # [ 0.499176] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.501469] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.502404] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.504424] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.505360] audit: initializing netlink subsys (disabled) gitlab # [ 0.506411] audit: type=2000 audit(1793024322.851:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.506650] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.508351] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.509349] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.510349] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.511348] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.512383] cpuidle: using governor menu gitlab # [ 0.514560] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.515595] PCI: Using configuration type 1 for base access gitlab # [ 0.516350] PCI: Using configuration type 1 for extended access gitlab # [ 0.517544] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.519687] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.521228] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.522237] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.523268] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.528169] ACPI: Added _OSI(Module Device) gitlab # [ 0.530358] ACPI: Added _OSI(Processor Device) gitlab # [ 0.531354] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.539323] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.547420] ACPI: Interpreter enabled gitlab # [ 0.549556] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.551359] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.553582] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.557354] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.559807] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.573541] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.575363] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.579140] acpiphp: Slot [3] registered gitlab # [ 0.580375] acpiphp: Slot [4] registered gitlab # [ 0.581393] acpiphp: Slot [5] registered gitlab # [ 0.582391] acpiphp: Slot [6] registered gitlab # [ 0.584391] acpiphp: Slot [7] registered gitlab # [ 0.585411] acpiphp: Slot [8] registered gitlab # [ 0.586405] acpiphp: Slot [9] registered gitlab # [ 0.588392] acpiphp: Slot [10] registered gitlab # [ 0.589390] acpiphp: Slot [11] registered gitlab # [ 0.591414] acpiphp: Slot [12] registered gitlab # [ 0.592392] acpiphp: Slot [13] registered gitlab # [ 0.593390] acpiphp: Slot [14] registered gitlab # [ 0.595390] acpiphp: Slot [15] registered gitlab # [ 0.596172] acpiphp: Slot [16] registered gitlab # [ 0.596895] acpiphp: Slot [17] registered gitlab # [ 0.597368] acpiphp: Slot [18] registered gitlab # [ 0.598138] acpiphp: Slot [19] registered gitlab # [ 0.599370] acpiphp: Slot [20] registered gitlab # [ 0.600097] acpiphp: Slot [21] registered gitlab # [ 0.600370] acpiphp: Slot [22] registered gitlab # [ 0.601157] acpiphp: Slot [23] registered gitlab # [ 0.602370] acpiphp: Slot [24] registered gitlab # [ 0.603090] acpiphp: Slot [25] registered gitlab # [ 0.603368] acpiphp: Slot [26] registered gitlab # [ 0.604129] acpiphp: Slot [27] registered gitlab # [ 0.604369] acpiphp: Slot [28] registered gitlab # [ 0.605082] acpiphp: Slot [29] registered gitlab # [ 0.606370] acpiphp: Slot [30] registered gitlab # [ 0.607127] acpiphp: Slot [31] registered gitlab # [ 0.607360] PCI host bridge to bus 0000:00 gitlab # [ 0.608078] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.609350] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.610349] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.612349] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.613348] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.614350] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.615583] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.617831] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.619820] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.622400] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.623330] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.624252] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.626181] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.627258] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.628369] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.630405] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.632404] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.634648] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.635355] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.637562] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.648392] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.649362] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.650369] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.651512] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.654107] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.658357] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.660356] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.661371] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.673357] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.679334] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.690390] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.692371] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.695410] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.701432] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.711389] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.713369] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.715409] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.722394] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.729371] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.731365] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.733424] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.737916] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.745413] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.746361] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.747372] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.754645] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.768380] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.771401] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.773409] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.779478] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.789391] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.792371] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.794406] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.797369] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.802838] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.807376] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.809395] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.814323] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.823390] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.825370] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.828412] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.834445] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.844392] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.846370] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.849409] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.861109] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.863676] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.865648] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.867625] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.869517] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.874520] iommu: Default domain type: Translated gitlab # [ 0.875349] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.876786] ACPI: bus type USB registered gitlab # [ 0.877453] usbcore: registered new interface driver usbfs gitlab # [ 0.878364] usbcore: registered new interface driver hub gitlab # [ 0.879327] usbcore: registered new device driver usb gitlab # [ 0.882387] NetLabel: Initializing gitlab # [ 0.883020] NetLabel: domain hash size = 128 gitlab # [ 0.883348] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.884398] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.885396] PCI: Using ACPI for IRQ routing gitlab # [ 0.886684] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.887345] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.887345] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.890354] vgaarb: loaded gitlab # [ 0.891085] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.891350] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.896503] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.898064] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.898810] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.900268] pnp: PnP ACPI init gitlab # [ 0.901474] pnp: PnP ACPI: found 6 devices gitlab # [ 0.911159] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.912735] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.913759] NET: Registered PF_INET protocol family gitlab # [ 0.915864] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.933345] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.934872] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.936332] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.939941] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.941339] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.942540] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.944181] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.945639] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.947047] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.948119] NET: Registered PF_XDP protocol family gitlab # [ 0.948974] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 0.950054] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 0.951136] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 0.952312] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.953649] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.955493] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 0.956513] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 0.958941] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 0.961539] PCI: CLS 0 bytes, default 64 gitlab # [ 0.962404] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 0.962961] Trying to unpack rootfs image as initramfs... gitlab # [ 0.963491] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 0.963611] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns gitlab # [ 0.987326] Initialise system trusted keyrings gitlab # [ 0.988532] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 0.999909] Key type asymmetric registered gitlab # [ 1.000700] Asymmetric key parser 'x509' registered gitlab # [ 1.001625] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 1.003376] io scheduler mq-deadline registered gitlab # [ 1.004243] io scheduler kyber registered gitlab # [ 1.008478] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 1.009826] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 1.012172] Linux agpgart interface v0.103 gitlab # [ 1.012952] ACPI: bus type drm_connector registered gitlab # [ 1.015502] usbcore: registered new interface driver usbserial_generic gitlab # [ 1.016638] usbserial: USB Serial support registered for generic gitlab # [ 1.017691] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 1.017691] Please enable it if your BIOS has the CPPC option. gitlab # [ 1.020060] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 1.021508] drop_monitor: Initializing network drop monitor service gitlab # [ 1.022734] NET: Registered PF_INET6 protocol family gitlab # [ 1.024413] Segment Routing with IPv6 gitlab # [ 1.025142] In-situ OAM (IOAM) with IPv6 gitlab # [ 1.028786] IPI shorthand broadcast: enabled gitlab # [ 1.033099] sched_clock: Marking stable (885012570, 148075769)->(1054497417, -21409078) gitlab # [ 1.034961] registered taskstats version 1 gitlab # [ 1.035998] Loading compiled-in X.509 certificates gitlab # [ 1.045496] Demotion targets for Node 0: null gitlab # [ 1.046610] Key type .fscrypt registered gitlab # [ 1.047349] Key type fscrypt-provisioning registered gitlab # [ 1.048335] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.049315] ima: Allocated hash algorithm: sha1 gitlab # [ 1.050171] ima: No architecture policies found gitlab # [ 1.051277] PM: Magic number: 14:734:334 gitlab # [ 1.052027] tty tty55: hash matches gitlab # [ 1.053544] RAS: Correctable Errors collector initialized. gitlab # [ 1.057989] clk: Disabling unused clocks gitlab # [ 1.058704] PM: genpd: Disabling unused power domains gitlab # [ 1.269334] Freeing initrd memory: 29392K gitlab # [ 1.276393] Freeing unused decrypted memory: 2028K gitlab # [ 1.282580] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.285327] Write protecting the kernel read-only data: 32768k gitlab # [ 1.290122] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.293878] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.362368] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.363477] Run /init as init process gitlab # [ 1.376144] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.398581] fuse: init (API version 7.45) gitlab # [ 1.406580] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.413192] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.416518] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.458168] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.794889] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.835853] systemd[1]: Detected virtualization kvm. gitlab # [ 1.838151] systemd[1]: Detected architecture x86-64. gitlab # [ 1.840305] systemd[1]: Running in initrd. gitlab # [ 1.842729] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.845662] systemd[1]: Hostname set to . gitlab # [ 1.960428] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 2.005806] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 2.015681] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 2.016887] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 2.018363] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 2.019553] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 2.020708] systemd[1]: Reached target Path Units. gitlab # [ 2.021610] systemd[1]: Reached target Slice Units. gitlab # [ 2.022556] systemd[1]: Reached target Swaps. gitlab # [ 2.023417] systemd[1]: Reached target Timer Units. gitlab # [ 2.024437] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 2.025686] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 2.026864] systemd[1]: Listening on Journal Sockets. gitlab # [ 2.027863] systemd[1]: Listening on udev Control Socket. gitlab # [ 2.028898] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 2.029896] systemd[1]: Reached target Socket Units. gitlab # [ 2.031880] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 2.034152] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 2.036292] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 2.039105] systemd[1]: Starting Journal Service... gitlab # [ 2.043171] systemd[1]: Starting Load Kernel Modules... gitlab # [ 2.045822] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 2.050156] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.053568] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.061544] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.066465] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.073275] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.074636] systemd-journald[90]: Collecting audit messages is disabled. gitlab # [ 2.082740] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.103173] netfs: FS-Cache loaded gitlab # [ 2.105172] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.108054] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 2.109177] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 2.113773] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 2.116045] 9pnet: Installing 9P2000 support gitlab # [ 2.119619] systemd[1]: Finished Load Kernel Modules. gitlab # [ 2.122128] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 2.123480] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 2.125301] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 2.132684] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.985310] systemd-modules-load[92]: Using 4[ 2.134060] systemd[1]: Started Journal Service. gitlab # probe threads gitlab # [ 1.987611] systemd-modules-load[92]: Inserted module 'virtio_balloon' gitlab # [ 1.988712] systemd-modules-load[92]: Inserted module 'virtio_gpu' gitlab # [ 1.989730] systemd-modules-load[92]: Inserted module 'dm_mod' gitlab # [ 1.990725] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.992231] systemd[1]: Reached target Local File Systems. gitlab # [ 1.993282] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.994389] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 2.001106] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 2.006990] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.016173] systemd-udevd[105]: Using default interface naming scheme 'v261'. gitlab # [ 2.028031] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.042027] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.043061] systemd[1]: Reached target System Initialization. gitlab # [ 2.043822] systemd[1]: Reached target Basic System. gitlab # [ 2.291831] SCSI subsystem initialized gitlab # [ 2.305032] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.319254] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.319987] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.322642] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.323523] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.324639] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.325486] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.326571] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.327763] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.329117] usb usb1: Product: UHCI Host Controller gitlab # [ 2.329136] scsi host0: ata_piix gitlab # [ 2.329321] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.331150] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.332734] scsi host1: ata_piix gitlab # [ 2.334175] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.335296] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.336810] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.337729] hub 1-0:1.0: USB hub found gitlab # [ 2.338549] hub 1-0:1.0: 2 ports detected gitlab # [ 2.341263] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.345362] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.348107] virtio_blk virtio5: [vdb] 11953328 512-byte logical blocks (6.12 GB/5.70 GiB) gitlab # [ 2.214766] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.244924] systemd-vconsole-setup[150]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.246581] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.493830] ata2: found unknown device (class 0) gitlab # [ 2.496652] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.500970] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.393287] (udev-worker)[120]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.398614] (udev-worker)[120]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.550807] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.409537] (udev-worker)[127]: Network inter[ 2.558188] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # face NamePolicy= disabled on kernel command line. gitlab # [ 2.429387] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.433866] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.435743] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.437340] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.588255] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.620887] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.479374] systemd-fsck[160]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.486326] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.727687] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.730725] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.733382] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.735052] usb 1-1: Manufacturer: QEMU gitlab # [ 2.736559] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.776298] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.787337] usbcore: registered new interface driver usbhid gitlab # [ 2.789154] usbhid: USB HID core driver gitlab # [ 2.796463] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.798788] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.907221] systemd[1]: Mounting /sysroot... gitlab # [ 3.207185] EXT4-fs (vda): mounted filesystem 95d97819-c1cc-42e2-8273-c6b26cf67210 r/w with ordered data mode. Quota mode: none. gitlab # [ 3.066457] systemd[1]: Mounted /sysroot. gitlab # [ 3.068382] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.071855] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.073758] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.075742] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.079807] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.087219] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.094311] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.101171] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.103521] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.107627] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.258197] 9p: Installing v9fs 9p2000 file system support gitlab # [ 3.114074] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.115961] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.264684] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.117334] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.118236] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.119677] systemd[1]: Reloading... gitlab # [ 3.174089] systemd[1]: Reloading finished in 56 ms. gitlab # [ 3.198151] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.201236] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.203262] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.205809] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.208118] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace... gitlab # [ 3.210756] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.212940] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.215461] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.217503] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.234506] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.237127] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.907438] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.955338] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.957399] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.959431] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.961396] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.989059] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.991745] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 4.009611] systemd[1]: Finished Find NixOS closure. gitlab # [ 4.011443] systemd[1]: Reached target Initrd Default Target. gitlab # [ 4.013758] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.052132] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.054237] systemd[1]: Stopped target Basic System. gitlab # [ 4.055963] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.057803] systemd[1]: Stopped target Path Units. gitlab # [ 4.059462] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.062070] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.064971] systemd[1]: Stopped target Slice Units. gitlab # [ 4.068204] systemd[1]: Stopped target Socket Units. gitlab # [ 4.073295] systemd[1]: Stopped target System Initialization. gitlab # [ 4.075494] systemd[1]: Stopped target Swaps. gitlab # [ 4.077831] systemd[1]: Stopped target Timer Units. gitlab # [ 4.079518] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.081549] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.083507] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.085930] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.087621] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.091174] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.093099] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.095216] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.096781] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.099054] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.100582] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.102595] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.104584] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.106572] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.108216] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.109643] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.111329] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.112927] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.114142] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.115791] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.117438] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.118499] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.119446] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.120353] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.121340] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.122198] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.123086] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.124080] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.125085] systemd[1]: Closed udev Control Socket. gitlab # [ 4.125783] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.126579] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.127648] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.128633] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.129722] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.130694] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.131646] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.146531] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.147607] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.148346] systemd[1]: Reached target Switch Root. gitlab # [ 4.149453] systemd[1]: Starting NixOS Activation... gitlab # [ 4.267742] initrd-nixos-activation-start[228]: booting system configuration /nix/store/5d6gba0gcd87p7hv97lrikhzxsxqvh2v-nixos-system-gitlab-test gitlab # [ 4.312803] initrd-nixos-activation-start[228]: running activation script... gitlab # [ 4.547690] initrd-nixos-activation-start[251]: setting up /etc... gitlab # [ 4.638238] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.639410] systemd[1]: Finished NixOS Activation. gitlab # [ 4.641855] systemd[1]: Starting Switch Root... gitlab # [ 4.671375] systemd[1]: Switching root. gitlab # [ 4.882828] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). gitlab # [ 4.976983] NET: Registered PF_VSOCK protocol family gitlab # [ 5.348230] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.358431] systemd[1]: Detected virtualization kvm. gitlab # [ 5.360271] systemd[1]: Detected architecture x86-64. gitlab # [ 5.362301] systemd[1]: Detected first boot. gitlab # [ 5.364801] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.519475] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.607522] systemd[1]: Applying preset policy. gitlab # [ 5.724502] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 5.832356] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 5.833964] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 5.836311] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 5.838385] systemd[1]: Created slice Slice /system/getty. gitlab # [ 5.839763] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 5.841281] systemd[1]: Created slice User and Session Slice. gitlab # [ 5.842241] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.843485] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 5.844640] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 5.845539] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 5.846392] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 5.847321] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 5.848121] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 5.848936] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 5.849919] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 5.850855] systemd[1]: Reached target Path Units. gitlab # [ 5.851609] systemd[1]: Reached target Remote File Systems. gitlab # [ 5.852463] systemd[1]: Reached target Slice Units. gitlab # [ 5.853288] systemd[1]: Reached target Swaps. gitlab # [ 5.854708] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 5.856685] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 5.858166] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 5.859764] systemd[1]: Listening on Factory Reset Management. gitlab # [ 5.860757] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 5.863193] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 5.864638] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 5.866704] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 5.867882] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 5.869128] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.870567] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 5.873402] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 5.874519] systemd[1]: Listening on udev Control Socket. gitlab # [ 5.875449] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 5.878366] systemd[1]: Mounting Huge Pages File System... gitlab # [ 5.880494] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 5.882659] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 5.885558] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 5.892000] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 5.893303] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 5.897509] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 5.898563] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 5.900208] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.913678] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.921551] systemd[1]: Mounting FUSE Control File System... gitlab # [ 5.923868] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.933843] systemd[1]: Starting Journal Service... gitlab # [ 5.938496] systemd[1]: Starting Load Kernel Modules... gitlab # [ 5.948309] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 5.952578] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 5.954648] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.961218] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 5.967887] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 5.968955] systemd[1]: Mounted Huge Pages File System. gitlab # [ 5.970428] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 5.970532] systemd-journald[321]: Collecting audit messages is enabled. gitlab # [ 5.970789] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 5.973190] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 5.974135] EXT4-fs (vda): re-mounted 95d97819-c1cc-42e2-8273-c6b26cf67210. gitlab # [ 5.976433] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 5.978297] loop: module loaded gitlab # [ 5.978658] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 5.980440] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 5.982000] systemd[1]: Mounted FUSE Control File System. gitlab # [ 5.983466] systemd[1]: Finished Load Kernel Modules. gitlab # [ 5.984803] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 5.986401] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 5.839479] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 5.988660] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 5.842226] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 5.843367] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 5.844578] systemd-modules-l[ 5.992565] systemd[1]: Starting Firewall... gitlab # oad[322]: Using 3 probe threads gitlab # [ 5.846139] s[ 5.993599] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # ystemd-modules-load[322]: Inserted module 'tls' gitlab # [ 5.848368] systemd-modules-load[322]: Inserted module 'loop' gitlab # [ 5.850428] systemd-oomd[324]: No swap; memory pressure usage will be degraded gitlab # [ 6.001162] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.003566] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.008931] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.010197] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.012756] systemd[1]: Started Journal Service. gitlab # [ 5.867072] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 5.868337] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 5.873220] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 5.876228] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 5.879584] systemd[1]: Reached target First Boot Complete. gitlab # [ 5.881544] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 5.890780] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 5.895128] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.045699] systemd-journald[321]: Received client request to flush runtime journal. gitlab # [ 5.927366] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 5.928388] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 5.929806] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 5.932404] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 5.947289] systemd-udevd[362]: Using default interface naming scheme 'v261'. gitlab # [ 5.967084] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 5.978188] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.044860] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.070792] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.073652] (udev-worker)[423]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.075889] (udev-worker)[423]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.077701] (udev-worker)[422]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.086419] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.089106] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.090269] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.091965] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.094267] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.096275] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.097814] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.099184] systemd[1]: Finished Firewall. gitlab # [ 6.295432] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.298313] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.298313] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.298372] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.304262] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.313421] Console: switching to colour dummy device 80x25 gitlab # [ 6.314800] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.314802] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.316282] ACPI: button: Power Button [PWRF] gitlab # [ 6.320296] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.321270] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.330344] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.332022] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.334436] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.342612] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.343279] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 gitlab # [ 6.355194] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.355872] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.356890] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.357666] rtc_cmos 00:05: setting system clock to 2026-10-26T14:18:48 UTC (1793024328) gitlab # [ 6.359312] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.361352] systemd-journald[321]: Time jumped backwards, rotating. gitlab # [ 6.362911] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 6.364694] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6 gitlab # [ 6.381217] FDC 0 is a S82078B gitlab # [ 6.260361] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.278129] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.279251] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.294066] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.317598] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.322325] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.337415] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.486824] ppdev: user-space parallel port driver gitlab # [ 6.490980] kvm_amd: TSC scaling supported gitlab # [ 6.492105] kvm_amd: Nested Virtualization enabled gitlab # [ 6.492635] kvm_amd: Nested Paging enabled gitlab # [ 6.493341] kvm_amd: LBR virtualization supported gitlab # [ 6.493841] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.494517] kvm_amd: Virtual GIF supported gitlab # [ 6.494968] kvm_amd: Virtual NMI enabled gitlab # [ 6.525945] EDAC MC: Ver: 3.0.0 gitlab # [ 6.395606] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.398161] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.689203] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.713883] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.715869] systemd[1]: Reached target Local File Systems. gitlab # [ 6.717756] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.720001] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.722446] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.724561] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.727505] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.733213] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.760143] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.765257] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.783039] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.788336] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.792562] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 6.812839] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 6.820748] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 6.822381] systemd[1]: Starting Update is Completed... gitlab # [ 6.835906] systemd[1]: Finished Update is Completed. gitlab # [ 6.889380] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 6.891498] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.151308] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.153551] systemd[1]: Reached target System Initialization. gitlab # [ 7.155595] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.158069] systemd[1]: Started logrotate.timer. gitlab # [ 7.159735] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.161970] systemd[1]: Reached target Timer Units. gitlab # [ 7.163716] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.165943] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.167758] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.169730] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.172658] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.174977] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.177174] systemd[1]: Reached target Socket Units. gitlab # [ 7.218408] dbus-broker-launch[578]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.221650] dbus-broker-launch[578]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.224313] dbus-broker-launch[578]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.229485] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.243588] dbus-broker-launch[578]: Ready gitlab # [ 7.246168] systemd[1]: Reached target Basic System. gitlab # [ 7.249060] systemd[1]: Started backdoor.service. gitlab # [ 7.251670] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.254356] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.266127] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.270792] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.273536] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.278698] systemd[1]: Started Reset console on configuration changes. gitlab # [ 7.286220] systemd[1]: Starting resolvconf update... gitlab # connecting to host... gitlab # [ 7.297299] systemd[1]: Finished Post-Boot Actions. gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab: connected to guest root shell gitlab # [ 7.305361] logrotate[583]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab: (connecting took 7.91 seconds) gitlab # [ 7.305991] logrotate[583]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab: (finished: waiting for the VM to finish booting, in 7.92 seconds) gitlab # [ 7.306543] logrotate[583]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.308950] logrotate[583]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.309636] logrotate[583]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.310522] logrotate[583]: Allocating hash table for state file, size 64 entries gitlab # [ 7.311456] logrotate[583]: Handling 4 logs gitlab # [ 7.312437] logrotate[583]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.313616] logrotate[583]: considering log /var/log/btmp gitlab # [ 7.314555] logrotate[583]: Creating new state gitlab # [ 7.315625] logrotate[583]: Now: 2026-10-26 14:18 gitlab # [ 7.316188] logrotate[583]: Last rotated at 2026-10-26 14:00 gitlab # [ 7.316650] logrotate[583]: log does not need rotating (log has already been rotated) gitlab # [ 7.317181] logrotate[583]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.317634] logrotate[583]: considering log /var/log/wtmp gitlab # [ 7.318118] logrotate[583]: Creating new state gitlab # [ 7.318300] logrotate[583]: Now: 2026-10-26 14:18 gitlab # [ 7.318834] logrotate[583]: Last rotated at 2026-10-26 14:00 gitlab # [ 7.319730] logrotate[583]: log does not need rotating (log has already been rotated) gitlab # [ 7.320439] logrotate[583]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.322886] logrotate[583]: switching euid from 0 to 165 and egid from 0 to 165 (pid 583) gitlab # [ 7.323614] logrotate[583]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.324230] logrotate[583]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.325093] logrotate[583]: Creating new state gitlab # [ 7.325530] logrotate[583]: switching euid from 165 to 0 and egid from 165 to 0 (pid 583) gitlab # [ 7.326063] logrotate[583]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.326505] logrotate[583]: switching euid from 0 to 60 and egid from 0 to 60 (pid 583) gitlab # [ 7.328563] logrotate[583]: considering log /var/log/nginx/*.log gitlab # [ 7.329160] logrotate[583]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.329576] logrotate[583]: Creating new state gitlab # [ 7.330105] logrotate[583]: not running postrotate script, since no logs were rotated gitlab # [ 7.330591] logrotate[583]: switching euid from 60 to 0 and egid from 60 to 0 (pid 583) gitlab # [ 7.330985] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.331610] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.332103] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.332541] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.333055] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.333507] systemd[1]: Starting User Login Management... gitlab # [ 7.344384] nsncd[584]: Oct 26 14:18:49.634 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.376361] systemd-logind[618]: New seat seat0. gitlab # [ 7.383363] systemd-logind[618]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.384691] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.385657] systemd-logind[618]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard) gitlab # [ 7.386871] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.387707] systemd-logind[618]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.389174] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.390079] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.390913] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.391749] systemd[1]: Started User Login Management. gitlab # [ 7.392556] systemd[1]: Starting linger-users.service... gitlab # [ 7.393513] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.394239] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.394682] systemd[1]: nscd.service: Consumed 25ms CPU time over 121ms wall clock time, 7M memory peak, 5.5M read from disk. gitlab # [ 7.396108] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.404905] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.405908] nsncd[676]: Oct 26 14:18:49.695 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.406677] systemd[1]: Finished linger-users.service. gitlab # [ 7.407530] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.408115] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.409129] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.416353] systemd[1]: Finished resolvconf update. gitlab # [ 7.417021] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.419048] systemd[1]: Starting DHCP Client... gitlab # [ 7.420892] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.423249] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.446382] network-addresses-eth1-start[701]: adding address 192.168.1.1/24... done gitlab # [ 7.448938] network-addresses-eth1-start[701]: adding address 2001:db8:1::1/64... done gitlab # [ 7.452541] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.489788] dhcpcd[712]: dhcpcd-10.3.2 starting gitlab # [ 7.491715] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.492616] systemd[1]: Reached target Network. gitlab # [ 7.494059] dhcpcd[765]: dev: loaded udev gitlab # [ 7.494717] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.495758] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.502075] systemd[1]: Start[ 7.650314] 8021q: 802.1Q VLAN Support v1.8 gitlab # ing PostgreSQL Server... gitlab # [ 7.651257] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 7.506318] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 7.508779] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.518113] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.532103] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.537721] systemd[1]: Started Getty on tty1. gitlab # [ 7.538443] systemd[1]: Reached target Login Prompts. gitlab # [ 7.742232] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 7.746397] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 7.747615] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 7.749316] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 7.750629] cfg80211: failed to load regulatory.db gitlab # [ 7.625571] nginx-pre-start[789]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.626654] nginx-pre-start[789]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.630562] systemd[1]: Started Nginx Web Server. gitlab # [ 7.782175] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.635750] dhcpcd[765]: eth0: waiting for carrier gitlab # [ 7.637193] dhcpcd[765]: eth0: carrier acquired gitlab # [ 7.640068] dhcpcd[765]: DUID 00:01:00:01:32:72:1d:c9:52:54:00:12:34:56 gitlab # [ 7.641436] dhcpcd[765]: eth0: IAID 00:12:34:56 gitlab # [ 7.642207] dhcpcd[765]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.647508] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.648483] postgresql-pre-start[793]: This user must also own the server process. gitlab # [ 7.652411] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.654190] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.655199] postgresql-pre-start[793]: The default text search configuration will be set to "english". gitlab # [ 7.656512] postgresql-pre-start[793]: Data page checksums are enabled. gitlab # [ 7.657840] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.659932] postgresql-pre-start[793]: creating subdirectories ... ok gitlab # [ 7.660512] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.662334] redis-server[790]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.663587] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.664419] redis-server[790]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.665245] redis-server[790]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=790, just started gitlab # [ 7.666845] redis-server[790]: Configuration loaded gitlab # [ 7.668517] redis[790]: monotonic clock: POSIX clock_gettime gitlab # [ 7.669189] redis[790]: Running mode=standalone, port=0. gitlab # [ 7.669774] redis[790]: Server initialized gitlab # [ 7.670593] redis[790]: Ready to accept connections unix gitlab # [ 7.671135] redis[790]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.700298] postgresql-pre-start[793]: selecting default "max_connections" ... 100 gitlab # [ 7.742525] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB gitlab # [ 7.974563] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.116664] postgresql-pre-start[793]: selecting default time zone ... UTC gitlab # [ 8.118129] postgresql-pre-start[793]: creating configuration files ... ok gitlab # [ 8.176556] gitlab-workhorse[826]: time="2026-10-26T14:18:50Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.177287] gitlab-workhorse[826]: time="2026-10-26T14:18:50Z" level=info msg="Using redis/go-redis" gitlab # [ 8.177880] gitlab-workhorse[826]: time="2026-10-26T14:18:50Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.303383] postgresql-pre-start[793]: running bootstrap script ... ok gitlab # [ 8.461426] dhcpcd[765]: eth0: soliciting a DHCP lease gitlab # [ 8.619405] NET: Registered PF_PACKET protocol family gitlab # [ 8.483815] dhcpcd[765]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 8.489267] dhcpcd[765]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.727625] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok gitlab # [ 9.008436] postgresql-pre-start[793]: syncing data to disk ... ok gitlab # [ 9.009680] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 9.010579] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 9.011456] postgresql-pre-start[793]: Success. You can now start the database server using: gitlab # [ 9.011983] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 9.138798] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 9.141296] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 9.142537] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 9.145942] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 9.160070] postgres[861]: [861] LOG: database system was shut down at 2026-10-26 14:18:51 GMT gitlab # [ 9.167930] postgres[852]: [852] LOG: database system is ready to accept connections gitlab # [ 9.173555] systemd[1]: Started PostgreSQL Server. gitlab # [ 9.178452] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 9.330651] postgresql-setup-start[877]: CREATE DATABASE gitlab # [ 9.353610] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[870]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 9.355154] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[870]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 9.356526] postgresql-setup-start[882]: CREATE ROLE gitlab # [ 9.368099] postgresql-setup-start[886]: ALTER DATABASE gitlab # [ 9.390285] systemd[1]: Finished gitlab-config.service. gitlab # [ 9.391761] postgresql-setup-start[900]: CREATE ROLE gitlab # [ 9.392481] systemd[1]: Started gitaly.service. gitlab # [ 9.395697] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 9.396809] systemd[1]: Reached target PostgreSQL. gitlab # [ 9.397793] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 9.398807] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.439089] dhcpcd[765]: eth0: soliciting an IPv6 router gitlab # [ 9.439795] dhcpcd[765]: eth0: Router Advertisement from fe80::2 gitlab # [ 9.440425] dhcpcd[765]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 9.441315] dhcpcd[765]: eth0: adding route to fec0::/64 gitlab # [ 9.442040] dhcpcd[765]: eth0: adding default route via fe80::2 gitlab # [ 9.485867] gitlab-postgresql-start[922]: CREATE DATABASE gitlab # [ 9.524229] gitlab-postgresql-start[927]: CREATE EXTENSION gitlab # [ 9.598627] gitlab-postgresql-start[929]: CREATE EXTENSION gitlab # [ 9.601924] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 9.929158] gitaly[903]: time="2026-10-26T14:18:52.218Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=903 gitlab # [ 9.930612] gitaly[903]: time="2026-10-26T14:18:52.219Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=903 gitlab # [ 9.932052] gitaly[903]: time="2026-10-26T14:18:52.219Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=903 gitlab # [ 9.933127] gitaly[903]: time="2026-10-26T14:18:52.219Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=903 gitlab # [ 9.933792] gitaly[903]: time="2026-10-26T14:18:52.219Z" level=info msg="Starting Gitaly" pid=903 version= gitlab # [ 10.103308] gitaly[903]: time="2026-10-26T14:18:52.393Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=172 pid=903 gitlab # [ 10.104353] gitaly[903]: time="2026-10-26T14:18:52.393Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=903 gitlab # [ 10.106987] gitaly[903]: time="2026-10-26T14:18:52.397Z" level=info msg="finished initializing command factory" duration_ms=3 pid=903 gitlab # [ 10.107680] gitaly[903]: time="2026-10-26T14:18:52.397Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-903/git-exec-2012626003.d/git pid=903 gitlab # [ 10.114362] gitaly[903]: time="2026-10-26T14:18:52.404Z" level=info msg="finished detecting git version" duration_ms=7 pid=903 gitlab # [ 10.115111] gitaly[903]: time="2026-10-26T14:18:52.404Z" level=info msg="using Git version" pid=903 version=2.53.g gitlab # [ 10.117972] gitaly[903]: time="2026-10-26T14:18:52.408Z" level=info msg="clearing disk cache object folder" pid=903 storage=default gitlab # [ 10.119894] gitaly[903]: time="2026-10-26T14:18:52.408Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3909388098 pid=903 storage=default gitlab # [ 10.122481] gitaly[903]: time="2026-10-26T14:18:52.408Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3909388098 pid=903 storage=default gitlab # [ 10.125298] gitaly[903]: time="2026-10-26T14:18:52.408Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=903 gitlab # [ 10.128073] gitaly[903]: time="2026-10-26T14:18:52.408Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=903 gitlab # [ 10.130793] gitaly[903]: time="2026-10-26T14:18:52.409Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3909388098 clear_duration_ms=0 pid=903 storage=default gitlab # [ 10.155419] gitaly[903]: time="2026-10-26T14:18:52.445Z" level=info msg="counting repositories" pid=903 gitlab # [ 10.156890] gitaly[903]: time="2026-10-26T14:18:52.445Z" level=info msg="starting to count repositories" pid=903 storage_path=/var/gitlab/state/repositories gitlab # [ 10.159021] gitaly[903]: time="2026-10-26T14:18:52.445Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=903 gitlab # [ 10.159885] gitaly[903]: time="2026-10-26T14:18:52.446Z" level=info msg="finished tempdir cleaner walk" pid=903 storage=default time_ms=0 gitlab # [ 10.160750] gitaly[903]: time="2026-10-26T14:18:52.446Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=903 schema=unix gitlab # [ 10.161691] gitaly[903]: time="2026-10-26T14:18:52.445Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=903 storage_path=/var/gitlab/state/repositories gitlab # [ 10.162503] gitaly[903]: time="2026-10-26T14:18:52.446Z" level=info msg="completed counting all repositories" counting_duration=0 pid=903 gitlab # [ 10.162703] gitaly[903]: time="2026-10-26T14:18:52.446Z" level=info msg="listening at address" address=/run/gitaly/gitaly-903/sock.d/intern pid=903 schema=unix gitlab # [ 10.163400] gitaly[903]: time="2026-10-26T14:18:52.447Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=903 gitlab # [ 10.163836] gitaly[903]: time="2026-10-26T14:18:52.448Z" level=info msg="Started Gitaly" duration_ms=228 pid=903 gitlab # [ 10.164615] gitaly[903]: time="2026-10-26T14:18:52.448Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=903 gitlab # [ 10.165429] gitaly[903]: time="2026-10-26T14:18:52.448Z" level=info msg="maintenance: daily scheduled" pid=903 scheduled="2026-10-27 12:00:00 +0000 UTC" gitlab # [ 10.752801] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[915]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.754209] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[915]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.781150] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[915]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.097329] gitaly[903]: time="2026-10-26T14:18:54.386Z" level=info msg="License database preloaded" duration_ms=2147 pid=903 gitlab # [ 13.174324] dhcpcd[765]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.176492] dhcpcd[765]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.178325] dhcpcd[765]: eth0: adding default route via 10.0.2.2 gitlab # [ 13.297776] systemd[1]: Started DHCP Client. gitlab # [ 13.299917] systemd[1]: Reached target Network is Online. gitlab # [ 39.507545] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[915]: W, [2026-10-26T14:19:21.797066 #915] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 41.405377] postgres[1300]: [1300] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 41.407740] postgres[1300]: [1300] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 41.409177] postgres[1300]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 41.411503] postgres[1300]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 41.413445] postgres[1300]: attidentity AS identity, gitlab # [ 41.415370] postgres[1300]: attgenerated as attgenerated gitlab # [ 41.416880] postgres[1300]: FROM pg_attribute a gitlab # [ 41.419197] postgres[1300]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 41.421142] postgres[1300]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 41.422953] postgres[1300]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 41.425320] postgres[1300]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 41.427181] postgres[1300]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 41.429111] postgres[1300]: ORDER BY a.attnum gitlab # [ 41.430963] postgres[1300]: gitlab # [ 44.728644] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1333]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 44.730636] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1333]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 48.231591] gitlab-workhorse[826]: time="2026-10-26T14:19:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 58.232977] gitlab-workhorse[826]: time="2026-10-26T14:19:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 59.522367] postgres[1399]: [1399] ERROR: relation "table_without_models" does not exist gitlab # [ 59.525193] postgres[1399]: [1399] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.242407] gitlab-workhorse[826]: time="2026-10-26T14:19:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 70.830301] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 70.832529] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 70.834303] systemd[1]: Starting gitlab.service... gitlab # [ 71.188904] bundle[1566]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 71.190203] bundle[1566]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 71.193803] bundle[1566]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 73.799103] sidekiq-cluster[1565]: {"severity":"INFO","time":"2026-10-26T14:19:56.072Z","message":"Starting cluster with 1 processes"} gitlab # [ 73.918126] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.190Z","pid":1566,"message":"* Enabling systemd notification integration"} gitlab # [ 73.919229] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.207Z","pid":1566,"message":"Puma starting in cluster mode..."} gitlab # [ 73.920254] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.207Z","pid":1566,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 73.920994] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.207Z","pid":1566,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 73.921736] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.207Z","pid":1566,"message":"* Min threads: 0"} gitlab # [ 73.922602] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.207Z","pid":1566,"message":"* Max threads: 4"} gitlab # [ 73.923456] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.207Z","pid":1566,"message":"* Environment: production"} gitlab # [ 73.924164] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.207Z","pid":1566,"message":"* Master PID: 1566"} gitlab # [ 73.924928] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.207Z","pid":1566,"message":"* Workers: 2"} gitlab # [ 73.925955] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.208Z","pid":1566,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 73.926628] bundle[1566]: {"timestamp":"2026-10-26T14:19:56.208Z","pid":1566,"message":"* Preloading application"} gitlab # [ 78.243568] gitlab-workhorse[826]: time="2026-10-26T14:20:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 88.244600] gitlab-workhorse[826]: time="2026-10-26T14:20:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 95.780151] bundle[1566]: W, [2026-10-26T14:20:18.069686 #1566] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 97.974436] sidekiq-cluster[1596]: 2026-10-26T14:20:20.263Z pid=1596 tid=wic INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1596, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431513600} gitlab # [ 98.139783] sidekiq-cluster[1596]: W, [2026-10-26T14:20:20.429856 #1596] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 98.177781] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:20.467Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 98.250891] gitlab-workhorse[826]: time="2026-10-26T14:20:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 100.002651] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.292Z","message":"GitLab reliable fetch activated!"} gitlab # [ 100.003684] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.292Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 100.023483] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.313Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 100.025930] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.316Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 100.028338] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.318Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 100.030595] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.320Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 100.032908] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.323Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 100.035119] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.325Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 100.037090] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.327Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 100.038803] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.329Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 100.040634] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.330Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 100.042556] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.332Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 100.044341] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.334Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 100.046626] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.336Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 100.048574] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.338Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 100.050433] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.340Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 100.052613] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.342Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 100.054505] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.344Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 100.057343] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.347Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 100.059831] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.350Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 100.062330] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.352Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 100.064765] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.355Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 100.067326] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.357Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 100.069483] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.359Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 100.071453] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.361Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 100.073717] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.363Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 100.075772] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.366Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 100.078326] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.368Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 100.080731] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.371Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 100.083175] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.373Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 100.085711] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.375Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 100.088339] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.378Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 100.090708] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.380Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 100.093468] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.383Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 100.095895] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.386Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 100.098369] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.388Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 100.100460] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.390Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 100.102537] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.392Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 100.104908] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.395Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 100.107454] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.397Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 100.109569] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.399Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 100.111594] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.401Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 100.114213] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.404Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 100.116196] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.406Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 100.118419] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.408Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 100.120344] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.410Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 100.122836] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.413Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 100.125171] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.415Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 100.127247] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.417Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 100.129530] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.419Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 100.135302] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.425Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 100.140701] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.430Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 100.146446] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.436Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 100.152487] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.442Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 100.169092] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.459Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 100.172672] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.462Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 100.175860] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.466Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 100.179123] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.469Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 100.182291] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.472Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 100.185627] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.475Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 100.188485] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.478Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 100.191643] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.481Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 100.194979] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.485Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 100.199275] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.489Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 100.202383] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.492Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 100.205931] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.496Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 100.209051] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.499Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 100.212484] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.502Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 100.215390] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.505Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 100.247823] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.538Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 100.250355] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.540Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 100.252741] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.542Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 100.255236] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.545Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 100.257757] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.548Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 100.261258] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.551Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 100.263791] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.554Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 100.267101] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.557Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 100.269832] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.560Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 100.273100] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.563Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 100.275970] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.566Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 100.278723] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.569Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 100.281952] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.572Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 100.284576] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.574Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 100.287228] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.577Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 100.290648] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.580Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 100.293653] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.583Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 100.296439] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.586Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 100.299359] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.589Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 100.302038] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.592Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 100.304843] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.595Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 100.307288] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.597Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 100.310142] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.600Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 100.312519] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.602Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 100.315026] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.605Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 100.317341] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.607Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 100.319337] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.609Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 100.322101] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.612Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 100.324826] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.615Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 100.327351] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.617Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 100.329700] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.620Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 100.339130] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.629Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 100.341125] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.631Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 100.343214] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.633Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 100.345964] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.636Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 100.348682] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.639Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 100.351170] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.641Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 100.353486] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.643Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 100.355398] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.645Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 100.357668] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.648Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 100.360372] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.650Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 100.362596] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:22.652Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 103.744225] sidekiq-cluster[1596]: InitializerConnections Query: SET client_min_messages TO 'warning' gitlab # [ 103.746543] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 103.747533] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 103.749189] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 103.750394] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 103.751435] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 103.752906] sidekiq-cluster[1596]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 103.765414] sidekiq-cluster[1596]: InitializerConnections Query: SET standard_conforming_strings = on gitlab # [ 103.767285] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 103.767980] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 103.769473] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 103.771117] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 103.772063] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 103.772908] sidekiq-cluster[1596]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 103.785558] sidekiq-cluster[1596]: InitializerConnections Query: SET intervalstyle = iso_8601 gitlab # [ 103.786804] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 103.788114] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 103.788975] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 103.790241] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 103.791193] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 103.792166] sidekiq-cluster[1596]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 103.802338] sidekiq-cluster[1596]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname gitlab # [ 103.803554] sidekiq-cluster[1596]: FROM pg_type as t gitlab # [ 103.804497] sidekiq-cluster[1596]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz') gitlab # [ 103.806269] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 103.806872] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 103.807551] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 103.808278] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 103.808872] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 103.809526] sidekiq-cluster[1596]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 103.817161] sidekiq-cluster[1596]: InitializerConnections Query: SET SESSION timezone TO 'UTC' gitlab # [ 103.818085] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 103.818648] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 103.819182] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 103.819765] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 103.820570] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 103.821381] sidekiq-cluster[1596]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 103.836796] sidekiq-cluster[1596]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics' gitlab # [ 103.837690] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 103.838478] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 103.839144] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 103.839724] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 103.840573] sidekiq-cluster[1596]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 103.841395] sidekiq-cluster[1596]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 108.260867] gitlab-workhorse[826]: time="2026-10-26T14:20:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 118.270975] gitlab-workhorse[826]: time="2026-10-26T14:20:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 124.197235] postgres[2025]: [2025] ERROR: relation "table_without_models" does not exist gitlab # [ 124.199691] postgres[2025]: [2025] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 126.253780] postgres[2045]: [2045] ERROR: relation "table_without_models" does not exist gitlab # [ 126.254878] postgres[2045]: [2045] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 126.791456] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:49.080Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 126.792701] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:49.081Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 126.793872] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:49.081Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 126.795165] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:49.081Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 126.812064] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:49.101Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 128.069996] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:50.359Z","message":"Cleaning working queues"} gitlab # [ 128.072498] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:50.361Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"03cd6d62bdce97f55b69b1af","created_at":"2026-10-26T14:19:52.819Z","trace_propagation_headers":{"sentry-trace":"4fb00c6e994743689e6faee72715ca0a-9c2340cad7464788","baggage":"sentry-trace_id=4fb00c6e994743689e6faee72715ca0a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"0abfc7e0c624a1a2e573dcf815a8ce20","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T14:19:52.826Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-03cd6d62bdce97f55b69b1af: start","job_status":"start","queue_duration_s":57.534861,"scheduling_latency_s":57.534898} gitlab # [ 128.262223] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:20:50.552Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"03cd6d62bdce97f55b69b1af","created_at":"2026-10-26T14:19:52.819Z","trace_propagation_headers":{"sentry-trace":"4fb00c6e994743689e6faee72715ca0a-9c2340cad7464788","baggage":"sentry-trace_id=4fb00c6e994743689e6faee72715ca0a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"0abfc7e0c624a1a2e573dcf815a8ce20","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T14:19:52.826Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-03cd6d62bdce97f55b69b1af: done: 0.190846 sec","job_status":"done","queue_duration_s":57.534861,"scheduling_latency_s":57.534898,"redis_calls":31,"redis_duration_s":0.007748,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.004856,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001861,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.084930906,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.190846,"completed_at":"2026-10-26T14:20:50.552Z","load_balancing_strategy":"primary","db_duration_s":0.059847,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 128.337062] gitlab-workhorse[826]: time="2026-10-26T14:20:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 129.034861] bundle[1566]: {"timestamp":"2026-10-26T14:20:51.324Z","pid":1566,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 129.036521] bundle[1566]: {"timestamp":"2026-10-26T14:20:51.324Z","pid":1566,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 129.038497] bundle[1566]: {"timestamp":"2026-10-26T14:20:51.324Z","pid":1566,"message":"! #\u003cThread:0x000079da50370ec0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 129.040121] bundle[1566]: {"timestamp":"2026-10-26T14:20:51.324Z","pid":1566,"message":"! #\u003cThread:0x000079da5060c2b0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 129.041395] bundle[1566]: {"timestamp":"2026-10-26T14:20:51.324Z","pid":1566,"message":"Use Ctrl-C to stop"} gitlab # [ 129.070526] bundle[1566]: {"timestamp":"2026-10-26T14:20:51.325Z","pid":1566,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 129.396891] bundle[1566]: {"timestamp":"2026-10-26T14:20:51.687Z","pid":1566,"message":"- Worker 0 (PID: 2144) booted in 0.29s, phase: 0"} gitlab # [ 129.434128] bundle[1566]: {"timestamp":"2026-10-26T14:20:51.724Z","pid":1566,"message":"- Worker 1 (PID: 2148) booted in 0.31s, phase: 0"} gitlab # [ 129.438042] systemd[1]: Started gitlab.service. gitlab # [ 129.438692] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 129.439918] systemd[1]: Starting setup-gitlab.service... gitlab # [ 129.465492] setup-gitlab-start[2173]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 131.639528] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:20:53 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 2146 gitlab # [ 131.644978] setup-gitlab-start[2173]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 131.647759] setup-gitlab-start[2173]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 131.660677] runuser[2191]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 132.026629] setup-gitlab-start[2192]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 132.031915] setup-gitlab-start[2192]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 132.037218] setup-gitlab-start[2192]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 132.587947] setup-gitlab-start[2192]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 132.590105] setup-gitlab-start[2192]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 132.591326] setup-gitlab-start[2192]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 140.839792] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.129Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a25b2356053959164dbe7997","created_at":"2026-10-26T14:21:03.103Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86d729a7157915c8ca33f03714e31d89","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.127Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a25b2356053959164dbe7997: start","job_status":"start","queue_duration_s":0.0016,"scheduling_latency_s":0.001629} gitlab # [ 140.888436] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a25b2356053959164dbe7997","created_at":"2026-10-26T14:21:03.103Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86d729a7157915c8ca33f03714e31d89","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.127Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a25b2356053959164dbe7997: done: 0.048975 sec","job_status":"done","queue_duration_s":0.0016,"scheduling_latency_s":0.001629,"redis_calls":10,"redis_duration_s":0.005345,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000624,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001239,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000544204,"duration_s":0.048975,"completed_at":"2026-10-26T14:21:03.178Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 140.929468] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.180Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f8de74a8002562a603028b58","created_at":"2026-10-26T14:21:03.133Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9bb60eacf3a25844084078d0232a45af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.137Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f8de74a8002562a603028b58: start","job_status":"start","queue_duration_s":0.042004,"scheduling_latency_s":0.042026} gitlab # [ 140.943730] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.202Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 140.947993] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.210Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f8de74a8002562a603028b58","created_at":"2026-10-26T14:21:03.133Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9bb60eacf3a25844084078d0232a45af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.137Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f8de74a8002562a603028b58: done: 0.030597 sec","job_status":"done","queue_duration_s":0.042004,"scheduling_latency_s":0.042026,"redis_calls":10,"redis_duration_s":0.001937,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000346,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000614,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000339428,"duration_s":0.030597,"completed_at":"2026-10-26T14:21:03.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011367,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 140.988554] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.211Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6d4512eb6c2c88f1247179fc","created_at":"2026-10-26T14:21:03.147Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"248c2f26570d10a5df7b5076e955f7b3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.158Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6d4512eb6c2c88f1247179fc: start","job_status":"start","queue_duration_s":0.053644,"scheduling_latency_s":0.053665} gitlab # [ 141.021517] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6d4512eb6c2c88f1247179fc","created_at":"2026-10-26T14:21:03.147Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"248c2f26570d10a5df7b5076e955f7b3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.158Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6d4512eb6c2c88f1247179fc: done: 0.099389 sec","job_status":"done","queue_duration_s":0.053644,"scheduling_latency_s":0.053665,"redis_calls":13,"redis_duration_s":0.013127999999999999,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000386,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004699,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008043,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.056,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.051178012999999994,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.099389,"completed_at":"2026-10-26T14:21:03.311Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055572,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 141.043901] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6ac737eab521baeb389214ff","created_at":"2026-10-26T14:21:03.168Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbdbc35140900c038371552b52cfcfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.238Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6ac737eab521baeb389214ff: start","job_status":"start","queue_duration_s":0.074429,"scheduling_latency_s":0.074446} gitlab # [ 141.044870] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.330Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 141.049605] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6ac737eab521baeb389214ff","created_at":"2026-10-26T14:21:03.168Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbdbc35140900c038371552b52cfcfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.238Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6ac737eab521baeb389214ff: done: 0.026556 sec","job_status":"done","queue_duration_s":0.074429,"scheduling_latency_s":0.074446,"redis_calls":10,"redis_duration_s":0.013103,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000867,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011192,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002787506,"duration_s":0.026556,"completed_at":"2026-10-26T14:21:03.339Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.092916] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.340Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b3026518eb77a3234878f46e","created_at":"2026-10-26T14:21:03.243Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"619892d983fd1ef95927c18655fa77c6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.261Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b3026518eb77a3234878f46e: start","job_status":"start","queue_duration_s":0.07939,"scheduling_latency_s":0.079405} gitlab # [ 141.093746] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b3026518eb77a3234878f46e","created_at":"2026-10-26T14:21:03.243Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"619892d983fd1ef95927c18655fa77c6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.261Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b3026518eb77a3234878f46e: done: 0.014734 sec","job_status":"done","queue_duration_s":0.07939,"scheduling_latency_s":0.079405,"redis_calls":12,"redis_duration_s":0.0017339999999999999,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00058,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219861,"duration_s":0.014734,"completed_at":"2026-10-26T14:21:03.355Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.160887] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.356Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"1f4d1d1be80f1e77d1a39a6f","created_at":"2026-10-26T14:21:03.285Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f085e410e380c8c23f1c2c0568d29334","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-26T14:21:03.294Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-1f4d1d1be80f1e77d1a39a6f: start","job_status":"start","queue_duration_s":0.061609,"scheduling_latency_s":0.061623} gitlab # [ 141.161603] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.364Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 141.162443] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.368Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"1f4d1d1be80f1e77d1a39a6f","created_at":"2026-10-26T14:21:03.285Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f085e410e380c8c23f1c2c0568d29334","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-26T14:21:03.294Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-1f4d1d1be80f1e77d1a39a6f: done: 0.012321 sec","job_status":"done","queue_duration_s":0.061609,"scheduling_latency_s":0.061623,"redis_calls":10,"redis_duration_s":0.001368,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225727,"duration_s":0.012321,"completed_at":"2026-10-26T14:21:03.368Z","load_balancing_strategy":"primary","db_duration_s":0.000282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.210740] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.369Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"1a4eeb8c9b4fb855187a2bbf","created_at":"2026-10-26T14:21:03.302Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"636d2c04101473628ed60dfd4faf2aa5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.310Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-1a4eeb8c9b4fb855187a2bbf: start","job_status":"start","queue_duration_s":0.059688,"scheduling_latency_s":0.059703} gitlab # [ 141.211630] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"1a4eeb8c9b4fb855187a2bbf","created_at":"2026-10-26T14:21:03.302Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"636d2c04101473628ed60dfd4faf2aa5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.310Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-1a4eeb8c9b4fb855187a2bbf: done: 0.020874 sec","job_status":"done","queue_duration_s":0.059688,"scheduling_latency_s":0.059703,"redis_calls":12,"redis_duration_s":0.001949,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00037379,"exclusive_lock_hold_duration_s":0.007594261,"duration_s":0.020874,"completed_at":"2026-10-26T14:21:03.390Z","load_balancing_strategy":"primary","db_duration_s":0.004774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.258882] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.391Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b8a3dce2d92b1a51b7869978","created_at":"2026-10-26T14:21:03.324Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5a18dee79d4bb4d18c43a1f57073db9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-26T14:21:03.333Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b8a3dce2d92b1a51b7869978: start","job_status":"start","queue_duration_s":0.058531,"scheduling_latency_s":0.058545} gitlab # [ 141.259797] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.399Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 141.263042] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b8a3dce2d92b1a51b7869978","created_at":"2026-10-26T14:21:03.324Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5a18dee79d4bb4d18c43a1f57073db9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-26T14:21:03.333Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b8a3dce2d92b1a51b7869978: done: 0.012595 sec","job_status":"done","queue_duration_s":0.058531,"scheduling_latency_s":0.058545,"redis_calls":10,"redis_duration_s":0.00144,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216508,"duration_s":0.012595,"completed_at":"2026-10-26T14:21:03.404Z","load_balancing_strategy":"primary","db_duration_s":0.000254,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.322380] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"78827cb6418b3ea96adf5365","created_at":"2026-10-26T14:21:03.523Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"234cefbfa474ead882c52fc9f8860e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.528Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-78827cb6418b3ea96adf5365: start","job_status":"start","queue_duration_s":0.0017,"scheduling_latency_s":0.001724} gitlab # [ 141.323298] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"78827cb6418b3ea96adf5365","created_at":"2026-10-26T14:21:03.523Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"234cefbfa474ead882c52fc9f8860e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.528Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-78827cb6418b3ea96adf5365: done: 0.075724 sec","job_status":"done","queue_duration_s":0.0017,"scheduling_latency_s":0.001724,"redis_calls":19,"redis_duration_s":0.020235,"redis_read_bytes":21,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.009543,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.001693,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005974,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000701486,"duration_s":0.075724,"completed_at":"2026-10-26T14:21:03.605Z","load_balancing_strategy":"primary","db_duration_s":0.010295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.351904] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"da224f076589a4e41ecd41ec","created_at":"2026-10-26T14:21:03.541Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba0c36a975680188cef2a9f2b1021180","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.554Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-da224f076589a4e41ecd41ec: start","job_status":"start","queue_duration_s":0.055536,"scheduling_latency_s":0.055568} gitlab # [ 141.610310] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"da224f076589a4e41ecd41ec","created_at":"2026-10-26T14:21:03.541Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba0c36a975680188cef2a9f2b1021180","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.554Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-da224f076589a4e41ecd41ec: done: 0.28981 sec","job_status":"done","queue_duration_s":0.055536,"scheduling_latency_s":0.055568,"redis_calls":14,"redis_duration_s":0.012561,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005617,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003923,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003021,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.049,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.142846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001836546,"exclusive_lock_hold_duration_s":0.220033273,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.28981,"completed_at":"2026-10-26T14:21:03.900Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.097618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.689660] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.901Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"536eb38874833961fa061b9a","created_at":"2026-10-26T14:21:03.558Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fc0af178ed93e0c565c3c997660f187","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.565Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-536eb38874833961fa061b9a: start","job_status":"start","queue_duration_s":0.336549,"scheduling_latency_s":0.336565} gitlab # [ 141.703289] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.945Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"536eb38874833961fa061b9a","created_at":"2026-10-26T14:21:03.558Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fc0af178ed93e0c565c3c997660f187","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.565Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-536eb38874833961fa061b9a: done: 0.044138 sec","job_status":"done","queue_duration_s":0.336549,"scheduling_latency_s":0.336565,"redis_calls":16,"redis_duration_s":0.003603,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001829,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000416254,"duration_s":0.044138,"completed_at":"2026-10-26T14:21:03.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008755,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.743504] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.947Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"908d602b82221a5df981a23b","created_at":"2026-10-26T14:21:03.563Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-3dd45da887b74ebe","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"234cefbfa474ead882c52fc9f8860e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.588Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-908d602b82221a5df981a23b: start","job_status":"start","queue_duration_s":0.359152,"scheduling_latency_s":0.359181} gitlab # [ 141.755717] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.962Z","message":"No existing merge request to be cleaned up."} gitlab # [ 141.756320] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.971Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"908d602b82221a5df981a23b","created_at":"2026-10-26T14:21:03.563Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-3dd45da887b74ebe","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"234cefbfa474ead882c52fc9f8860e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.588Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-908d602b82221a5df981a23b: done: 0.023954 sec","job_status":"done","queue_duration_s":0.359152,"scheduling_latency_s":0.359181,"redis_calls":13,"redis_duration_s":0.002043,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222374,"duration_s":0.023954,"completed_at":"2026-10-26T14:21:03.971Z","load_balancing_strategy":"primary","db_duration_s":0.003036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.757547] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.972Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e0079c62ccfa95b12537a668","created_at":"2026-10-26T14:21:03.563Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-3dd45da887b74ebe","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"234cefbfa474ead882c52fc9f8860e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.588Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e0079c62ccfa95b12537a668: start","job_status":"start","queue_duration_s":0.384043,"scheduling_latency_s":0.384058} gitlab # [ 141.804893] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.980Z","message":"No existing merge request to be cleaned up."} gitlab # [ 141.805675] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.986Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e0079c62ccfa95b12537a668","created_at":"2026-10-26T14:21:03.563Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-3dd45da887b74ebe","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"234cefbfa474ead882c52fc9f8860e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.588Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e0079c62ccfa95b12537a668: done: 0.013873 sec","job_status":"done","queue_duration_s":0.384043,"scheduling_latency_s":0.384058,"redis_calls":10,"redis_duration_s":0.001947,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013873,"completed_at":"2026-10-26T14:21:03.986Z","load_balancing_strategy":"primary","db_duration_s":0.001565,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.806705] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.987Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ed7508719eb9cfc93023ba7b","created_at":"2026-10-26T14:21:03.563Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-3dd45da887b74ebe","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"234cefbfa474ead882c52fc9f8860e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.588Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ed7508719eb9cfc93023ba7b: start","job_status":"start","queue_duration_s":0.399189,"scheduling_latency_s":0.399204} gitlab # [ 141.850258] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:03.995Z","message":"No existing merge request to be cleaned up."} gitlab # [ 141.850890] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.001Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ed7508719eb9cfc93023ba7b","created_at":"2026-10-26T14:21:03.563Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-3dd45da887b74ebe","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"234cefbfa474ead882c52fc9f8860e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.588Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ed7508719eb9cfc93023ba7b: done: 0.013522 sec","job_status":"done","queue_duration_s":0.399189,"scheduling_latency_s":0.399204,"redis_calls":10,"redis_duration_s":0.002308,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001331,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013522,"completed_at":"2026-10-26T14:21:04.001Z","load_balancing_strategy":"primary","db_duration_s":0.001417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.854186] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.002Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e962ba0ce7592b6a5558e178","created_at":"2026-10-26T14:21:03.563Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-3dd45da887b74ebe","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"234cefbfa474ead882c52fc9f8860e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.588Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e962ba0ce7592b6a5558e178: start","job_status":"start","queue_duration_s":0.413888,"scheduling_latency_s":0.413903} gitlab # [ 141.899119] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.011Z","message":"No existing merge request to be cleaned up."} gitlab # [ 141.899913] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.016Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e962ba0ce7592b6a5558e178","created_at":"2026-10-26T14:21:03.563Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-3dd45da887b74ebe","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"234cefbfa474ead882c52fc9f8860e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.588Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e962ba0ce7592b6a5558e178: done: 0.014325 sec","job_status":"done","queue_duration_s":0.413888,"scheduling_latency_s":0.413903,"redis_calls":10,"redis_duration_s":0.002464,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014325,"completed_at":"2026-10-26T14:21:04.016Z","load_balancing_strategy":"primary","db_duration_s":0.00166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.904164] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"991a6546506c84086c43d785","created_at":"2026-10-26T14:21:03.573Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6a349cecc783bd43552e6791f716ac1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.590Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-991a6546506c84086c43d785: start","job_status":"start","queue_duration_s":0.428109,"scheduling_latency_s":0.428125} gitlab # [ 141.918046] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.058Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"991a6546506c84086c43d785","created_at":"2026-10-26T14:21:03.573Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6a349cecc783bd43552e6791f716ac1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.590Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-991a6546506c84086c43d785: done: 0.040494 sec","job_status":"done","queue_duration_s":0.428109,"scheduling_latency_s":0.428125,"redis_calls":12,"redis_duration_s":0.004243,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000456,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001849,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000413739,"exclusive_lock_hold_duration_s":0.017560053,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.040494,"completed_at":"2026-10-26T14:21:04.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011396,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.973138] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.061Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"4b4d0faa8702ee5c44bfac46","created_at":"2026-10-26T14:21:03.602Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7a28458bfbe16380c22e50f9893f2b4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.609Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-4b4d0faa8702ee5c44bfac46: start","job_status":"start","queue_duration_s":0.451579,"scheduling_latency_s":0.451605} gitlab # [ 142.015230] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"4b4d0faa8702ee5c44bfac46","created_at":"2026-10-26T14:21:03.602Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7a28458bfbe16380c22e50f9893f2b4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.609Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-4b4d0faa8702ee5c44bfac46: done: 0.036593 sec","job_status":"done","queue_duration_s":0.451579,"scheduling_latency_s":0.451605,"redis_calls":10,"redis_duration_s":0.0023090000000000003,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000442,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001474,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000403403,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.036593,"completed_at":"2026-10-26T14:21:04.097Z","load_balancing_strategy":"primary","db_duration_s":0.008903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.016531] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.099Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6758adbff124298ef03c678f","created_at":"2026-10-26T14:21:03.640Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4136afb77b90dc6a8f76143c6921f5d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.652Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6758adbff124298ef03c678f: start","job_status":"start","queue_duration_s":0.447341,"scheduling_latency_s":0.447357} gitlab # [ 142.058944] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.114Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6758adbff124298ef03c678f","created_at":"2026-10-26T14:21:03.640Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4136afb77b90dc6a8f76143c6921f5d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.652Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6758adbff124298ef03c678f: done: 0.01405 sec","job_status":"done","queue_duration_s":0.447341,"scheduling_latency_s":0.447357,"redis_calls":10,"redis_duration_s":0.001331,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224889,"duration_s":0.01405,"completed_at":"2026-10-26T14:21:04.113Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000435,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.105172] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"f3baeb28623fcb385828c6b4","created_at":"2026-10-26T14:21:03.666Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67b89c9f89453df29d3b96d18b318798","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.672Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-f3baeb28623fcb385828c6b4: start","job_status":"start","queue_duration_s":0.442573,"scheduling_latency_s":0.442588} gitlab # [ 142.105905] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"f3baeb28623fcb385828c6b4","created_at":"2026-10-26T14:21:03.666Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67b89c9f89453df29d3b96d18b318798","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.672Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-f3baeb28623fcb385828c6b4: done: 0.015403 sec","job_status":"done","queue_duration_s":0.442573,"scheduling_latency_s":0.442588,"redis_calls":12,"redis_duration_s":0.001718,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000645,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000368762,"exclusive_lock_hold_duration_s":0.002233803,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.015403,"completed_at":"2026-10-26T14:21:04.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001055,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.151537] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c665adb7bfd9a0f41782fa56","created_at":"2026-10-26T14:21:03.686Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b6b2b73eb292d039425eb09ebc55528","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.691Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c665adb7bfd9a0f41782fa56: start","job_status":"start","queue_duration_s":0.439759,"scheduling_latency_s":0.439773} gitlab # [ 142.152503] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c665adb7bfd9a0f41782fa56","created_at":"2026-10-26T14:21:03.686Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b6b2b73eb292d039425eb09ebc55528","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.691Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c665adb7bfd9a0f41782fa56: done: 0.250981 sec","job_status":"done","queue_duration_s":0.439759,"scheduling_latency_s":0.439773,"redis_calls":565,"redis_duration_s":0.07413700000000001,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.073022,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.20072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000236622,"duration_s":0.250981,"completed_at":"2026-10-26T14:21:04.382Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.174715] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7f838d2756ad38ec729194b8","created_at":"2026-10-26T14:21:03.701Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.706Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7f838d2756ad38ec729194b8: start","job_status":"start","queue_duration_s":0.677508,"scheduling_latency_s":0.677524} gitlab # [ 142.187531] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7f838d2756ad38ec729194b8","created_at":"2026-10-26T14:21:03.701Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.706Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7f838d2756ad38ec729194b8: done: 0.085386 sec","job_status":"done","queue_duration_s":0.677508,"scheduling_latency_s":0.677524,"redis_calls":71,"redis_duration_s":0.020985,"redis_read_bytes":120,"redis_write_bytes":42574,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.004807,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000638,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014768,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000772,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000430781,"duration_s":0.085386,"completed_at":"2026-10-26T14:21:04.469Z","load_balancing_strategy":"primary","db_duration_s":0.004045,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.227856] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.472Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9e691def484dc854ff5fc24a","created_at":"2026-10-26T14:21:03.712Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7712e72e079dd6db35045d789859d320","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.720Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9e691def484dc854ff5fc24a: start","job_status":"start","queue_duration_s":0.751994,"scheduling_latency_s":0.752012} gitlab # [ 142.240306] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.501Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9e691def484dc854ff5fc24a","created_at":"2026-10-26T14:21:03.712Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7712e72e079dd6db35045d789859d320","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.720Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9e691def484dc854ff5fc24a: done: 0.028937 sec","job_status":"done","queue_duration_s":0.751994,"scheduling_latency_s":0.752012,"redis_calls":12,"redis_duration_s":0.002151,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000436368,"exclusive_lock_hold_duration_s":0.008903365,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.028937,"completed_at":"2026-10-26T14:21:04.501Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007733,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.296585] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"19e98821bd427256071cb4b3","created_at":"2026-10-26T14:21:03.727Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f37045279b57967af18561101c8183a0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.735Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-19e98821bd427256071cb4b3: start","job_status":"start","queue_duration_s":0.767287,"scheduling_latency_s":0.767301} gitlab # [ 142.297468] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.511Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 142.298055] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"19e98821bd427256071cb4b3","created_at":"2026-10-26T14:21:03.727Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f37045279b57967af18561101c8183a0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.735Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-19e98821bd427256071cb4b3: done: 0.013976 sec","job_status":"done","queue_duration_s":0.767287,"scheduling_latency_s":0.767301,"redis_calls":10,"redis_duration_s":0.001319,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238577,"duration_s":0.013976,"completed_at":"2026-10-26T14:21:04.516Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.337294] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.518Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"563fd8b234e8d665db04b2a8","created_at":"2026-10-26T14:21:03.746Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34cd9b27d31dd459e196b3a7be7d7ab2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.754Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-563fd8b234e8d665db04b2a8: start","job_status":"start","queue_duration_s":0.764248,"scheduling_latency_s":0.764262} gitlab # [ 142.382845] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.632Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"563fd8b234e8d665db04b2a8","created_at":"2026-10-26T14:21:03.746Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34cd9b27d31dd459e196b3a7be7d7ab2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.754Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-563fd8b234e8d665db04b2a8: done: 0.11399 sec","job_status":"done","queue_duration_s":0.764248,"scheduling_latency_s":0.764262,"redis_calls":12,"redis_duration_s":0.008396,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003331,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000667683,"exclusive_lock_hold_duration_s":0.091750209,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.11399,"completed_at":"2026-10-26T14:21:04.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010471,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null} gitlab # [ 142.429692] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9cf31a20d38fc8c2a2800aa0","created_at":"2026-10-26T14:21:03.763Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38233797f9a0bf5564eb18b269d5697a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-26T14:21:03.772Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9cf31a20d38fc8c2a2800aa0: start","job_status":"start","queue_duration_s":0.861813,"scheduling_latency_s":0.861827} gitlab # [ 142.430708] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.656Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9cf31a20d38fc8c2a2800aa0","created_at":"2026-10-26T14:21:03.763Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38233797f9a0bf5564eb18b269d5697a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-26T14:21:03.772Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9cf31a20d38fc8c2a2800aa0: done: 0.02218 sec","job_status":"done","queue_duration_s":0.861813,"scheduling_latency_s":0.861827,"redis_calls":10,"redis_duration_s":0.001356,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022433,"duration_s":0.02218,"completed_at":"2026-10-26T14:21:04.656Z","load_balancing_strategy":"primary","db_duration_s":0.002484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.479044] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.657Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7110f890b5a04a34982b2acc","created_at":"2026-10-26T14:21:03.782Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7729270f01bee39e9158bf614cfdd76","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.790Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7110f890b5a04a34982b2acc: start","job_status":"start","queue_duration_s":0.866583,"scheduling_latency_s":0.866597} gitlab # [ 142.479683] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.665Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 142.483553] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7110f890b5a04a34982b2acc","created_at":"2026-10-26T14:21:03.782Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-ce90ac77b8ce4da8","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7729270f01bee39e9158bf614cfdd76","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:03.790Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7110f890b5a04a34982b2acc: done: 0.013004 sec","job_status":"done","queue_duration_s":0.866583,"scheduling_latency_s":0.866597,"redis_calls":10,"redis_duration_s":0.001308,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212038,"duration_s":0.013004,"completed_at":"2026-10-26T14:21:04.670Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.527909] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2ef0b8a4230114163a1a3f9","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2ef0b8a4230114163a1a3f9: start","job_status":"start","queue_duration_s":0.210464,"scheduling_latency_s":0.210478} gitlab # [ 142.528668] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2ef0b8a4230114163a1a3f9","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2ef0b8a4230114163a1a3f9: done: 0.018272 sec","job_status":"done","queue_duration_s":0.210464,"scheduling_latency_s":0.210478,"redis_calls":16,"redis_duration_s":0.005347,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003228,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206172,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018272,"completed_at":"2026-10-26T14:21:04.689Z","load_balancing_strategy":"primary","db_duration_s":0.000285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.580756] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85cd7789d2dd0b8db61fb620","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85cd7789d2dd0b8db61fb620: start","job_status":"start","queue_duration_s":0.229991,"scheduling_latency_s":0.230005} gitlab # [ 142.581683] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85cd7789d2dd0b8db61fb620","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85cd7789d2dd0b8db61fb620: done: 0.010291 sec","job_status":"done","queue_duration_s":0.229991,"scheduling_latency_s":0.230005,"redis_calls":13,"redis_duration_s":0.001612,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010291,"completed_at":"2026-10-26T14:21:04.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.629332] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80916adb547790b5da6698ea","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80916adb547790b5da6698ea: start","job_status":"start","queue_duration_s":0.241149,"scheduling_latency_s":0.241162} gitlab # [ 142.630120] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80916adb547790b5da6698ea","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80916adb547790b5da6698ea: done: 0.010361 sec","job_status":"done","queue_duration_s":0.241149,"scheduling_latency_s":0.241162,"redis_calls":13,"redis_duration_s":0.0017629999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001251,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010361,"completed_at":"2026-10-26T14:21:04.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.640919] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc4cb8acb56a77f3ecb99ec9","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc4cb8acb56a77f3ecb99ec9: start","job_status":"start","queue_duration_s":0.252391,"scheduling_latency_s":0.252404} gitlab # [ 142.652587] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc4cb8acb56a77f3ecb99ec9","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc4cb8acb56a77f3ecb99ec9: done: 0.020612 sec","job_status":"done","queue_duration_s":0.252391,"scheduling_latency_s":0.252404,"redis_calls":13,"redis_duration_s":0.011266000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020612,"completed_at":"2026-10-26T14:21:04.733Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.706094] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1119a848099516004362dd02","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1119a848099516004362dd02: start","job_status":"start","queue_duration_s":0.273936,"scheduling_latency_s":0.273951} gitlab # [ 142.706820] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1119a848099516004362dd02","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1119a848099516004362dd02: done: 0.0112 sec","job_status":"done","queue_duration_s":0.273936,"scheduling_latency_s":0.273951,"redis_calls":13,"redis_duration_s":0.002197,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001478,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0112,"completed_at":"2026-10-26T14:21:04.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.736505] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83f1ec3a2e7337371ea48a9e","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83f1ec3a2e7337371ea48a9e: start","job_status":"start","queue_duration_s":0.286037,"scheduling_latency_s":0.286052} gitlab # [ 142.748600] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83f1ec3a2e7337371ea48a9e","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83f1ec3a2e7337371ea48a9e: done: 0.010332 sec","job_status":"done","queue_duration_s":0.286037,"scheduling_latency_s":0.286052,"redis_calls":13,"redis_duration_s":0.001613,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010332,"completed_at":"2026-10-26T14:21:04.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.800320] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"760cf165d742448a394cdd37","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-760cf165d742448a394cdd37: start","job_status":"start","queue_duration_s":0.29726,"scheduling_latency_s":0.297274} gitlab # [ 142.800950] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"760cf165d742448a394cdd37","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-760cf165d742448a394cdd37: done: 0.01004 sec","job_status":"done","queue_duration_s":0.29726,"scheduling_latency_s":0.297274,"redis_calls":13,"redis_duration_s":0.001565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01004,"completed_at":"2026-10-26T14:21:04.768Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.845146] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02d7e7784237037806482792","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02d7e7784237037806482792: start","job_status":"start","queue_duration_s":0.31024,"scheduling_latency_s":0.310254} gitlab # [ 142.845892] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02d7e7784237037806482792","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02d7e7784237037806482792: done: 0.013625 sec","job_status":"done","queue_duration_s":0.31024,"scheduling_latency_s":0.310254,"redis_calls":13,"redis_duration_s":0.00207,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001359,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013625,"completed_at":"2026-10-26T14:21:04.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.902363] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9569adae63a325906facdce5","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9569adae63a325906facdce5: start","job_status":"start","queue_duration_s":0.325052,"scheduling_latency_s":0.325072} gitlab # [ 142.903151] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9569adae63a325906facdce5","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9569adae63a325906facdce5: done: 0.010492 sec","job_status":"done","queue_duration_s":0.325052,"scheduling_latency_s":0.325072,"redis_calls":13,"redis_duration_s":0.001629,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010492,"completed_at":"2026-10-26T14:21:04.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.927904] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05539e1b9a00345e46c7cc88","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05539e1b9a00345e46c7cc88: start","job_status":"start","queue_duration_s":0.336457,"scheduling_latency_s":0.336471} gitlab # [ 142.939495] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05539e1b9a00345e46c7cc88","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05539e1b9a00345e46c7cc88: done: 0.009864 sec","job_status":"done","queue_duration_s":0.336457,"scheduling_latency_s":0.336471,"redis_calls":13,"redis_duration_s":0.001574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009864,"completed_at":"2026-10-26T14:21:04.806Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.984588] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf5847c73390c35d9fcd813e","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf5847c73390c35d9fcd813e: start","job_status":"start","queue_duration_s":0.347257,"scheduling_latency_s":0.347272} gitlab # [ 142.985692] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf5847c73390c35d9fcd813e","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf5847c73390c35d9fcd813e: done: 0.009775 sec","job_status":"done","queue_duration_s":0.347257,"scheduling_latency_s":0.347272,"redis_calls":13,"redis_duration_s":0.0015669999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009775,"completed_at":"2026-10-26T14:21:04.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.024583] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e171eccfef10a39a4ee03be5","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e171eccfef10a39a4ee03be5: start","job_status":"start","queue_duration_s":0.360811,"scheduling_latency_s":0.360826} gitlab # [ 143.064763] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e171eccfef10a39a4ee03be5","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e171eccfef10a39a4ee03be5: done: 0.010364 sec","job_status":"done","queue_duration_s":0.360811,"scheduling_latency_s":0.360826,"redis_calls":13,"redis_duration_s":0.0017800000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010364,"completed_at":"2026-10-26T14:21:04.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.066117] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fcf0706fc7de4bdeea6bce7","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fcf0706fc7de4bdeea6bce7: start","job_status":"start","queue_duration_s":0.372193,"scheduling_latency_s":0.372208} gitlab # [ 143.077402] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fcf0706fc7de4bdeea6bce7","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fcf0706fc7de4bdeea6bce7: done: 0.009843 sec","job_status":"done","queue_duration_s":0.372193,"scheduling_latency_s":0.372208,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009843,"completed_at":"2026-10-26T14:21:04.842Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.146085] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5447e4fa9ed2b576e69b7106","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5447e4fa9ed2b576e69b7106: start","job_status":"start","queue_duration_s":0.382913,"scheduling_latency_s":0.382927} gitlab # [ 143.146826] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5447e4fa9ed2b576e69b7106","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5447e4fa9ed2b576e69b7106: done: 0.009906 sec","job_status":"done","queue_duration_s":0.382913,"scheduling_latency_s":0.382927,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009906,"completed_at":"2026-10-26T14:21:04.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.189034] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99775bbefc7f39c9a1ff8929","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99775bbefc7f39c9a1ff8929: start","job_status":"start","queue_duration_s":0.444139,"scheduling_latency_s":0.444163} gitlab # [ 143.189647] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99775bbefc7f39c9a1ff8929","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99775bbefc7f39c9a1ff8929: done: 0.01229 sec","job_status":"done","queue_duration_s":0.444139,"scheduling_latency_s":0.444163,"redis_calls":13,"redis_duration_s":0.001695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01229,"completed_at":"2026-10-26T14:21:04.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.237108] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2076149f8130f85443aa6974","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2076149f8130f85443aa6974: start","job_status":"start","queue_duration_s":0.457271,"scheduling_latency_s":0.457284} gitlab # [ 143.237831] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2076149f8130f85443aa6974","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2076149f8130f85443aa6974: done: 0.010884 sec","job_status":"done","queue_duration_s":0.457271,"scheduling_latency_s":0.457284,"redis_calls":13,"redis_duration_s":0.0027990000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002222,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010884,"completed_at":"2026-10-26T14:21:04.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.280089] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a3a53b238272fde860742cf","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a3a53b238272fde860742cf: start","job_status":"start","queue_duration_s":0.469102,"scheduling_latency_s":0.469115} gitlab # [ 143.280811] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a3a53b238272fde860742cf","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a3a53b238272fde860742cf: done: 0.00995 sec","job_status":"done","queue_duration_s":0.469102,"scheduling_latency_s":0.469115,"redis_calls":13,"redis_duration_s":0.001673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00995,"completed_at":"2026-10-26T14:21:04.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.333108] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dbba897c0a7fadeba6206d2","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dbba897c0a7fadeba6206d2: start","job_status":"start","queue_duration_s":0.479946,"scheduling_latency_s":0.479961} gitlab # [ 143.333799] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dbba897c0a7fadeba6206d2","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dbba897c0a7fadeba6206d2: done: 0.010309 sec","job_status":"done","queue_duration_s":0.479946,"scheduling_latency_s":0.479961,"redis_calls":13,"redis_duration_s":0.001641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010309,"completed_at":"2026-10-26T14:21:04.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.341225] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12055b4a251884f49088fc39","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12055b4a251884f49088fc39: start","job_status":"start","queue_duration_s":0.491205,"scheduling_latency_s":0.491219} gitlab # [ 143.381177] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12055b4a251884f49088fc39","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12055b4a251884f49088fc39: done: 0.010136 sec","job_status":"done","queue_duration_s":0.491205,"scheduling_latency_s":0.491219,"redis_calls":13,"redis_duration_s":0.001657,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010136,"completed_at":"2026-10-26T14:21:04.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.386874] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"966ae227fec62cf0b1cc5d8a","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-966ae227fec62cf0b1cc5d8a: start","job_status":"start","queue_duration_s":0.502227,"scheduling_latency_s":0.502241} gitlab # [ 143.398205] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"966ae227fec62cf0b1cc5d8a","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-966ae227fec62cf0b1cc5d8a: done: 0.009997 sec","job_status":"done","queue_duration_s":0.502227,"scheduling_latency_s":0.502241,"redis_calls":13,"redis_duration_s":0.001631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009997,"completed_at":"2026-10-26T14:21:04.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.463302] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcb83737d0fa125af63acfa4","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcb83737d0fa125af63acfa4: start","job_status":"start","queue_duration_s":0.513231,"scheduling_latency_s":0.513245} gitlab # [ 143.464034] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcb83737d0fa125af63acfa4","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcb83737d0fa125af63acfa4: done: 0.010003 sec","job_status":"done","queue_duration_s":0.513231,"scheduling_latency_s":0.513245,"redis_calls":13,"redis_duration_s":0.001626,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010003,"completed_at":"2026-10-26T14:21:04.983Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.510049] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81adb4b2d6a063d42d3ebfc5","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81adb4b2d6a063d42d3ebfc5: start","job_status":"start","queue_duration_s":0.52425,"scheduling_latency_s":0.524263} gitlab # [ 143.510799] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81adb4b2d6a063d42d3ebfc5","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81adb4b2d6a063d42d3ebfc5: done: 0.009984 sec","job_status":"done","queue_duration_s":0.52425,"scheduling_latency_s":0.524263,"redis_calls":13,"redis_duration_s":0.0016129999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009984,"completed_at":"2026-10-26T14:21:04.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.550072] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:04.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e7cc56b200470e62b34fd76","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e7cc56b200470e62b34fd76: start","job_status":"start","queue_duration_s":0.536018,"scheduling_latency_s":0.536032} gitlab # [ 143.550779] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e7cc56b200470e62b34fd76","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e7cc56b200470e62b34fd76: done: 0.009953 sec","job_status":"done","queue_duration_s":0.536018,"scheduling_latency_s":0.536032,"redis_calls":13,"redis_duration_s":0.001682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009953,"completed_at":"2026-10-26T14:21:05.006Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.607803] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fd05b70541eef02d36017d3","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fd05b70541eef02d36017d3: start","job_status":"start","queue_duration_s":0.546846,"scheduling_latency_s":0.546859} gitlab # [ 143.608615] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fd05b70541eef02d36017d3","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fd05b70541eef02d36017d3: done: 0.009986 sec","job_status":"done","queue_duration_s":0.546846,"scheduling_latency_s":0.546859,"redis_calls":13,"redis_duration_s":0.001726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009986,"completed_at":"2026-10-26T14:21:05.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.616659] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e25c1c0d2139ee2b67228855","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e25c1c0d2139ee2b67228855: start","job_status":"start","queue_duration_s":0.55769,"scheduling_latency_s":0.557704} gitlab # [ 143.658734] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e25c1c0d2139ee2b67228855","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e25c1c0d2139ee2b67228855: done: 0.010194 sec","job_status":"done","queue_duration_s":0.55769,"scheduling_latency_s":0.557704,"redis_calls":13,"redis_duration_s":0.001836,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010194,"completed_at":"2026-10-26T14:21:05.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.661644] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fc40baf6f9b015e5fb51cd4","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fc40baf6f9b015e5fb51cd4: start","job_status":"start","queue_duration_s":0.568795,"scheduling_latency_s":0.568809} gitlab # [ 143.672669] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fc40baf6f9b015e5fb51cd4","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fc40baf6f9b015e5fb51cd4: done: 0.009893 sec","job_status":"done","queue_duration_s":0.568795,"scheduling_latency_s":0.568809,"redis_calls":13,"redis_duration_s":0.0016709999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009893,"completed_at":"2026-10-26T14:21:05.039Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.719026] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce0ea3bf3613e86c207dfc5b","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce0ea3bf3613e86c207dfc5b: start","job_status":"start","queue_duration_s":0.579981,"scheduling_latency_s":0.579996} gitlab # [ 143.719604] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce0ea3bf3613e86c207dfc5b","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce0ea3bf3613e86c207dfc5b: done: 0.009979 sec","job_status":"done","queue_duration_s":0.579981,"scheduling_latency_s":0.579996,"redis_calls":13,"redis_duration_s":0.001687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009979,"completed_at":"2026-10-26T14:21:05.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.762889] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e00f8a18f3839b5be5d4fcf6","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e00f8a18f3839b5be5d4fcf6: start","job_status":"start","queue_duration_s":0.59084,"scheduling_latency_s":0.590854} gitlab # [ 143.763709] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e00f8a18f3839b5be5d4fcf6","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e00f8a18f3839b5be5d4fcf6: done: 0.009925 sec","job_status":"done","queue_duration_s":0.59084,"scheduling_latency_s":0.590854,"redis_calls":13,"redis_duration_s":0.0017239999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009925,"completed_at":"2026-10-26T14:21:05.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.800644] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"649b4a34c757459ed081bdd9","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-649b4a34c757459ed081bdd9: start","job_status":"start","queue_duration_s":0.601713,"scheduling_latency_s":0.601726} gitlab # [ 143.804667] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"649b4a34c757459ed081bdd9","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-649b4a34c757459ed081bdd9: done: 0.009837 sec","job_status":"done","queue_duration_s":0.601713,"scheduling_latency_s":0.601726,"redis_calls":13,"redis_duration_s":0.001684,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009837,"completed_at":"2026-10-26T14:21:05.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.849035] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f0db6f30c6449a797f720f9","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f0db6f30c6449a797f720f9: start","job_status":"start","queue_duration_s":0.612889,"scheduling_latency_s":0.612903} gitlab # [ 143.849736] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f0db6f30c6449a797f720f9","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f0db6f30c6449a797f720f9: done: 0.009954 sec","job_status":"done","queue_duration_s":0.612889,"scheduling_latency_s":0.612903,"redis_calls":13,"redis_duration_s":0.001723,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009954,"completed_at":"2026-10-26T14:21:05.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.890915] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d8a557d36cfdafa59c83b88","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d8a557d36cfdafa59c83b88: start","job_status":"start","queue_duration_s":0.623706,"scheduling_latency_s":0.62372} gitlab # [ 143.892606] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d8a557d36cfdafa59c83b88","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d8a557d36cfdafa59c83b88: done: 0.00982 sec","job_status":"done","queue_duration_s":0.623706,"scheduling_latency_s":0.62372,"redis_calls":13,"redis_duration_s":0.001691,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00982,"completed_at":"2026-10-26T14:21:05.094Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.940174] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9241b3dc38fe41879fe272a","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9241b3dc38fe41879fe272a: start","job_status":"start","queue_duration_s":0.634401,"scheduling_latency_s":0.634414} gitlab # [ 143.940806] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9241b3dc38fe41879fe272a","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9241b3dc38fe41879fe272a: done: 0.009861 sec","job_status":"done","queue_duration_s":0.634401,"scheduling_latency_s":0.634414,"redis_calls":13,"redis_duration_s":0.001658,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009861,"completed_at":"2026-10-26T14:21:05.104Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.986073] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c873e50317a7c445ebaf7ae2","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c873e50317a7c445ebaf7ae2: start","job_status":"start","queue_duration_s":0.645136,"scheduling_latency_s":0.64515} gitlab # [ 143.986759] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c873e50317a7c445ebaf7ae2","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c873e50317a7c445ebaf7ae2: done: 0.009817 sec","job_status":"done","queue_duration_s":0.645136,"scheduling_latency_s":0.64515,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009817,"completed_at":"2026-10-26T14:21:05.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.034029] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0754b16c0f602a78752fb4aa","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0754b16c0f602a78752fb4aa: start","job_status":"start","queue_duration_s":0.65623,"scheduling_latency_s":0.656244} gitlab # [ 144.034675] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0754b16c0f602a78752fb4aa","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0754b16c0f602a78752fb4aa: done: 0.010076 sec","job_status":"done","queue_duration_s":0.65623,"scheduling_latency_s":0.656244,"redis_calls":13,"redis_duration_s":0.001888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001337,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010076,"completed_at":"2026-10-26T14:21:05.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.059183] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"067303723306621373424ecc","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-067303723306621373424ecc: start","job_status":"start","queue_duration_s":0.667188,"scheduling_latency_s":0.667202} gitlab # [ 144.098951] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"067303723306621373424ecc","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-067303723306621373424ecc: done: 0.010069 sec","job_status":"done","queue_duration_s":0.667188,"scheduling_latency_s":0.667202,"redis_calls":13,"redis_duration_s":0.001804,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010069,"completed_at":"2026-10-26T14:21:05.137Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.103131] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5338c57b1082f16ef4ac9c03","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5338c57b1082f16ef4ac9c03: start","job_status":"start","queue_duration_s":0.678139,"scheduling_latency_s":0.678153} gitlab # [ 144.114025] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5338c57b1082f16ef4ac9c03","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5338c57b1082f16ef4ac9c03: done: 0.009843 sec","job_status":"done","queue_duration_s":0.678139,"scheduling_latency_s":0.678153,"redis_calls":13,"redis_duration_s":0.001694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009843,"completed_at":"2026-10-26T14:21:05.148Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.155902] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43aef4d7c3d2632d3a30fd02","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43aef4d7c3d2632d3a30fd02: start","job_status":"start","queue_duration_s":0.688928,"scheduling_latency_s":0.68926} gitlab # [ 144.157892] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43aef4d7c3d2632d3a30fd02","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43aef4d7c3d2632d3a30fd02: done: 0.010038 sec","job_status":"done","queue_duration_s":0.688928,"scheduling_latency_s":0.68926,"redis_calls":13,"redis_duration_s":0.0015970000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010038,"completed_at":"2026-10-26T14:21:05.159Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.221580] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d9f396730d4ff0ef1d46f1d","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d9f396730d4ff0ef1d46f1d: start","job_status":"start","queue_duration_s":0.699844,"scheduling_latency_s":0.699858} gitlab # [ 144.222027] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d9f396730d4ff0ef1d46f1d","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d9f396730d4ff0ef1d46f1d: done: 0.009595 sec","job_status":"done","queue_duration_s":0.699844,"scheduling_latency_s":0.699858,"redis_calls":13,"redis_duration_s":0.001567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009595,"completed_at":"2026-10-26T14:21:05.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.273335] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60f3c1dc5fa88f9831bfb0ac","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60f3c1dc5fa88f9831bfb0ac: start","job_status":"start","queue_duration_s":0.710275,"scheduling_latency_s":0.710289} gitlab # [ 144.273975] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60f3c1dc5fa88f9831bfb0ac","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60f3c1dc5fa88f9831bfb0ac: done: 0.013014 sec","job_status":"done","queue_duration_s":0.710275,"scheduling_latency_s":0.710289,"redis_calls":13,"redis_duration_s":0.0017530000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013014,"completed_at":"2026-10-26T14:21:05.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.282629] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8466043740e387840678e69","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8466043740e387840678e69: start","job_status":"start","queue_duration_s":0.724495,"scheduling_latency_s":0.724516} gitlab # [ 144.293993] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8466043740e387840678e69","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8466043740e387840678e69: done: 0.010671 sec","job_status":"done","queue_duration_s":0.724495,"scheduling_latency_s":0.724516,"redis_calls":13,"redis_duration_s":0.001712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010671,"completed_at":"2026-10-26T14:21:05.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.339052] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0867a8cf5720816027db23c1","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0867a8cf5720816027db23c1: start","job_status":"start","queue_duration_s":0.736459,"scheduling_latency_s":0.736473} gitlab # [ 144.340760] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0867a8cf5720816027db23c1","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0867a8cf5720816027db23c1: done: 0.010033 sec","job_status":"done","queue_duration_s":0.736459,"scheduling_latency_s":0.736473,"redis_calls":13,"redis_duration_s":0.00164,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010033,"completed_at":"2026-10-26T14:21:05.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.402226] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed3b41a864eb6f3481023bcb","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed3b41a864eb6f3481023bcb: start","job_status":"start","queue_duration_s":0.747381,"scheduling_latency_s":0.747395} gitlab # [ 144.402911] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed3b41a864eb6f3481023bcb","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed3b41a864eb6f3481023bcb: done: 0.010305 sec","job_status":"done","queue_duration_s":0.747381,"scheduling_latency_s":0.747395,"redis_calls":13,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010305,"completed_at":"2026-10-26T14:21:05.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.445632] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"403fe11c14a179304fec30eb","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-403fe11c14a179304fec30eb: start","job_status":"start","queue_duration_s":0.758557,"scheduling_latency_s":0.758571} gitlab # [ 144.446434] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"403fe11c14a179304fec30eb","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-403fe11c14a179304fec30eb: done: 0.010471 sec","job_status":"done","queue_duration_s":0.758557,"scheduling_latency_s":0.758571,"redis_calls":13,"redis_duration_s":0.001756,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010471,"completed_at":"2026-10-26T14:21:05.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.494576] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8181c53b4a98de8abf06fefb","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8181c53b4a98de8abf06fefb: start","job_status":"start","queue_duration_s":0.769922,"scheduling_latency_s":0.769936} gitlab # [ 144.495500] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8181c53b4a98de8abf06fefb","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8181c53b4a98de8abf06fefb: done: 0.010535 sec","job_status":"done","queue_duration_s":0.769922,"scheduling_latency_s":0.769936,"redis_calls":13,"redis_duration_s":0.001691,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010535,"completed_at":"2026-10-26T14:21:05.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.538248] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d594ed6fd6188ca6ce3c0254","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d594ed6fd6188ca6ce3c0254: start","job_status":"start","queue_duration_s":0.781393,"scheduling_latency_s":0.781407} gitlab # [ 144.538881] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d594ed6fd6188ca6ce3c0254","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d594ed6fd6188ca6ce3c0254: done: 0.009716 sec","job_status":"done","queue_duration_s":0.781393,"scheduling_latency_s":0.781407,"redis_calls":13,"redis_duration_s":0.0014980000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009716,"completed_at":"2026-10-26T14:21:05.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.581648] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"370f900b827397d92af8e644","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-370f900b827397d92af8e644: start","job_status":"start","queue_duration_s":0.791967,"scheduling_latency_s":0.791981} gitlab # [ 144.582494] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"370f900b827397d92af8e644","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-370f900b827397d92af8e644: done: 0.00962 sec","job_status":"done","queue_duration_s":0.791967,"scheduling_latency_s":0.791981,"redis_calls":13,"redis_duration_s":0.0015400000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00962,"completed_at":"2026-10-26T14:21:05.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.632248] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f18362b1744fca691d9d28c","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f18362b1744fca691d9d28c: start","job_status":"start","queue_duration_s":0.80245,"scheduling_latency_s":0.802463} gitlab # [ 144.632855] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f18362b1744fca691d9d28c","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f18362b1744fca691d9d28c: done: 0.009553 sec","job_status":"done","queue_duration_s":0.80245,"scheduling_latency_s":0.802463,"redis_calls":13,"redis_duration_s":0.0015340000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009553,"completed_at":"2026-10-26T14:21:05.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.683188] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59d642f7ed173f0173425bb8","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59d642f7ed173f0173425bb8: start","job_status":"start","queue_duration_s":0.812855,"scheduling_latency_s":0.812868} gitlab # [ 144.683923] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59d642f7ed173f0173425bb8","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59d642f7ed173f0173425bb8: done: 0.009531 sec","job_status":"done","queue_duration_s":0.812855,"scheduling_latency_s":0.812868,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009531,"completed_at":"2026-10-26T14:21:05.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.731169] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8f3b7b4c9a80998325fac94","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8f3b7b4c9a80998325fac94: start","job_status":"start","queue_duration_s":0.823533,"scheduling_latency_s":0.823547} gitlab # [ 144.731762] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8f3b7b4c9a80998325fac94","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8f3b7b4c9a80998325fac94: done: 0.009551 sec","job_status":"done","queue_duration_s":0.823533,"scheduling_latency_s":0.823547,"redis_calls":13,"redis_duration_s":0.001553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009551,"completed_at":"2026-10-26T14:21:05.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.773206] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a33c9e03bdf0914d839d4c26","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a33c9e03bdf0914d839d4c26: start","job_status":"start","queue_duration_s":0.833923,"scheduling_latency_s":0.833937} gitlab # [ 144.773940] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:05.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a33c9e03bdf0914d839d4c26","created_at":"2026-10-26T14:21:04.405Z","trace_propagation_headers":{"sentry-trace":"de8683291e0647738d63ed516ff3d228-e842dd068a1d4351","baggage":"sentry-trace_id=de8683291e0647738d63ed516ff3d228,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ebb09cb07815a2150010aea1d1247c15","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:04.460Z","job_size_bytes":2,"pid":1596,"sidekiq_tid":"mag8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a33c9e03bdf0914d839d4c26: done: 0.009311 sec","job_status":"done","queue_duration_s":0.833923,"scheduling_latency_s":0.833937,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009311,"completed_at":"2026-10-26T14:21:05.303Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.976813] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2580134119 wd_nsec: 2580132825 gitlab # [ 157.884078] setup-gitlab-start[2192]: W, [2026-10-26T14:21:20.173662 #2192] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 179.086505] postgres[2393]: [2393] ERROR: relation "table_without_models" does not exist gitlab # [ 179.088353] postgres[2393]: [2393] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 182.519687] runuser[2191]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 182.521864] setup-gitlab-start[2173]: + systemctl restart gitlab-sidekiq.service gitlab # [ 182.546810] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 182.547769] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:44.836Z","message":"Shutting down"} gitlab # [ 182.548996] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:44.839Z","message":"Scheduler exiting..."} gitlab # [ 182.554255] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:44.844Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 182.556088] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:44.844Z","message":"Scheduler exiting..."} gitlab # [ 183.055754] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:45.345Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 183.558116] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:45.847Z","message":"Bye!"} gitlab # [ 183.580750] sidekiq-cluster[1596]: {"severity":"INFO","time":"2026-10-26T14:21:45.870Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1596,"worker_id":"sidekiq_0","memwd_rss_bytes":934957056,"retry":0} gitlab # [ 184.833507] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 184.835173] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 184.836545] systemd[1]: gitlab-sidekiq.service: Consumed 54.026s CPU time over 1min 54.001s wall clock time, 956.3M memory peak, 4.5M read from disk. gitlab # [ 184.844627] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 184.847881] setup-gitlab-start[2173]: + mkdir -p /var/lib/secrets gitlab # [ 184.851103] setup-gitlab-start[2173]: + echo nixbot-test-token-of-20-chars gitlab # [ 184.852601] setup-gitlab-start[2173]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 184.855214] setup-gitlab-start[2173]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars gitlab # [ 185.033146] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:47 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 147 gitlab # [ 185.499649] gitaly[903]: time="2026-10-26T14:21:47.789Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:57.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:47.789" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.500879] gitaly[903]: time="2026-10-26T14:21:47.789Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:57.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:47.789" grpc.time_ms=0.488 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.608403] gitaly[903]: time="2026-10-26T14:21:47.898Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:57.117" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:47.898" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.610513] gitaly[903]: time="2026-10-26T14:21:47.898Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:57.117" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:47.898" grpc.time_ms=0.468 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.689946] gitaly[903]: time="2026-10-26T14:21:47.980Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q diskcache=146f6cab-1c80-4783-8dcc-c841e47eafbe grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T14:21:57.156" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:47.936" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.691154] gitaly[903]: time="2026-10-26T14:21:47.980Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1573 command.oublock=32 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T14:21:57.156" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:47.936" grpc.time_ms=43.972 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.704149] gitaly[903]: time="2026-10-26T14:21:47.994Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:57.213" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:47.993" pid=903 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 185.705147] gitaly[903]: time="2026-10-26T14:21:47.994Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:57.213" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:47.993" grpc.time_ms=0.63 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.743528] gitaly[903]: time="2026-10-26T14:21:48.033Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T14:21:58.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.025" grpc.time_ms=7.742 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.802742] gitaly[903]: time="2026-10-26T14:21:48.092Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:58.072" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.092" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.804575] gitaly[903]: time="2026-10-26T14:21:48.093Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:58.072" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.092" grpc.time_ms=0.297 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.870020] gitaly[903]: time="2026-10-26T14:21:48.160Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q diskcache=726765dc-7fc1-4260-bb15-8aa1f417ee4f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T14:21:58.104" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.124" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.871498] gitaly[903]: time="2026-10-26T14:21:48.160Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1583 command.oublock=32 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-26T14:21:58.104" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.124" grpc.time_ms=35.572 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.891753] gitaly[903]: time="2026-10-26T14:21:48.181Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:58.161" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.181" pid=903 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 185.893058] gitaly[903]: time="2026-10-26T14:21:48.182Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:58.161" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.181" grpc.time_ms=0.327 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.909073] gitaly[903]: time="2026-10-26T14:21:48.199Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T14:21:58.167" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.188" grpc.time_ms=10.476 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.946348] gitaly[903]: time="2026-10-26T14:21:48.236Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:21:58.216" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.236" grpc.time_ms=0.126 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.965697] gitaly[903]: time="2026-10-26T14:21:48.255Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T14:21:58.235" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.255" grpc.time_ms=0.203 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 186.468707] gitaly[903]: time="2026-10-26T14:21:48.758Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DFEFH7VR59MHFWSWX03Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T14:21:58.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:48.749" grpc.time_ms=8.839 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 186.706419] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:48 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 1651 gitlab # [ 186.711808] setup-gitlab-start[2443]: {"id":1,"message":null,"error":null} gitlab # [ 187.839677] sidekiq-cluster[2431]: {"severity":"INFO","time":"2026-10-26T14:21:50.112Z","message":"Starting cluster with 1 processes"} gitlab # [ 191.828455] gitaly[903]: time="2026-10-26T14:21:54.117Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DNZ9TQC4YZD86PZ8K4CJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T14:22:04.087" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:54.107" grpc.time_ms=10.262 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.900958] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:54 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 164 gitlab # [ 191.903501] setup-gitlab-start[2173]: + mkdir -p /tmp/test-flake gitlab # [ 191.905823] setup-gitlab-start[2173]: + cd /tmp/test-flake gitlab # [ 191.906843] setup-gitlab-start[2173]: + git init -b master gitlab # [ 191.926060] setup-gitlab-start[2517]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 191.927059] setup-gitlab-start[2173]: + git config user.name test gitlab # [ 191.928358] setup-gitlab-start[2173]: + git config user.email test@example.com gitlab # [ 191.930204] setup-gitlab-start[2173]: + cat gitlab # [ 191.933918] setup-gitlab-start[2173]: + git add flake.nix gitlab # [ 191.939268] setup-gitlab-start[2173]: + git commit -m 'initial commit' gitlab # [ 191.963104] setup-gitlab-start[2522]: [master (root-commit) 23a7074] initial commit gitlab # [ 191.963991] setup-gitlab-start[2522]: 1 file changed, 10 insertions(+) gitlab # [ 191.965533] setup-gitlab-start[2522]: create mode 100644 flake.nix gitlab # [ 191.966526] setup-gitlab-start[2173]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 191.972681] setup-gitlab-start[2173]: + git push -u origin master gitlab # [ 192.039322] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 39 gitlab # [ 192.122437] gitaly[903]: time="2026-10-26T14:21:54.412Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DP8TYS5B068RTP2WANQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:54.401" grpc.time_ms=11.344 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 192.124813] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 83 gitlab # [ 192.802594] gitaly[903]: time="2026-10-26T14:21:55.092Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T14:22:05.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:55.082" grpc.time_ms=10.466 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.858091] gitaly[903]: time="2026-10-26T14:21:55.147Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=326 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-26T14:22:25.036" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-26T14:21:55.136" grpc.time_ms=10.719 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.944316] gitaly[903]: time="2026-10-26T14:21:55.234Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 duration_ms=667ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 192.968225] gitaly[903]: time="2026-10-26T14:21:55.258Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 duration_ms=23ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 192.970104] gitaly[903]: time="2026-10-26T14:21:55.258Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:21:54.565" grpc.time_ms=693.158 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.035923] gitaly[903]: time="2026-10-26T14:21:55.326Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:21:55.325" grpc.time_ms=0.817 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.098390] gitaly[903]: time="2026-10-26T14:21:55.388Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:21:55.387" grpc.time_ms=0.607 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.156915] gitaly[903]: time="2026-10-26T14:21:55.447Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:21:55.446" grpc.time_ms=0.496 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.266366] gitaly[903]: time="2026-10-26T14:21:55.556Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T14:22:05.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:21:55.546" grpc.time_ms=9.655 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.293964] gitaly[903]: time="2026-10-26T14:21:55.584Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1576 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-26T14:22:05.021" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:21:55.562" grpc.time_ms=21.882 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.307684] gitaly[903]: time="2026-10-26T14:21:55.597Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 duration_ms=99ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 193.309156] gitaly[903]: time="2026-10-26T14:21:55.597Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:21:55.494" grpc.time_ms=102.767 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.334640] gitaly[903]: time="2026-10-26T14:21:55.624Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 diskcache=0439aa84-0f97-4777-978b-59c00351290b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:54.497" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.335916] gitaly[903]: time="2026-10-26T14:21:55.625Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=249 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13917 command.oublock=32 command.real_time_ms=1116 command.spawn_token_fork_ms=1 command.system_time_ms=160 command.user_time_ms=89 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:54.497" grpc.time_ms=1126.975 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.356655] gitlab-workhorse[826]: time="2026-10-26T14:21:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 193.357484] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:55 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1220 gitlab # [ 193.361829] setup-gitlab-start[2526]: To http://gitlab/root/test-flake.git gitlab # [ 193.362540] setup-gitlab-start[2526]: * [new branch] master -> master gitlab # [ 193.366474] setup-gitlab-start[2526]: branch 'master' set up to track 'origin/master'. gitlab # [ 193.371413] systemd[1]: Finished setup-gitlab.service. gitlab # [ 193.378455] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 194.47 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 194.705397] nixbot[2613]: {"ts": "2026-10-26T14:21:56.994Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 194.735680] nixbot[2613]: {"ts": "2026-10-26T14:21:57.025Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 194.765795] nixbot[2613]: {"ts": "2026-10-26T14:21:57.055Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 194.771698] nixbot[2613]: {"ts": "2026-10-26T14:21:57.061Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 194.777253] nixbot[2613]: {"ts": "2026-10-26T14:21:57.067Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 194.785837] nixbot[2613]: {"ts": "2026-10-26T14:21:57.075Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 194.796051] nixbot[2613]: {"ts": "2026-10-26T14:21:57.086Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 194.799520] nixbot[2613]: {"ts": "2026-10-26T14:21:57.089Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 194.814551] nixbot[2613]: {"ts": "2026-10-26T14:21:57.104Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 194.818123] nixbot[2613]: {"ts": "2026-10-26T14:21:57.108Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 194.832086] nixbot[2613]: {"ts": "2026-10-26T14:21:57.122Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 194.846258] nixbot[2613]: {"ts": "2026-10-26T14:21:57.136Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 194.852068] nixbot[2613]: {"ts": "2026-10-26T14:21:57.142Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 194.860387] nixbot[2613]: {"ts": "2026-10-26T14:21:57.150Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 194.870923] nixbot[2613]: {"ts": "2026-10-26T14:21:57.160Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 194.878693] nixbot[2613]: {"ts": "2026-10-26T14:21:57.168Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 194.886114] nixbot[2613]: {"ts": "2026-10-26T14:21:57.176Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 194.893310] nixbot[2613]: {"ts": "2026-10-26T14:21:57.183Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 194.904663] nixbot[2613]: {"ts": "2026-10-26T14:21:57.194Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 194.907709] nixbot[2613]: {"ts": "2026-10-26T14:21:57.197Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 194.910575] nixbot[2613]: {"ts": "2026-10-26T14:21:57.200Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 194.917389] nixbot[2613]: {"ts": "2026-10-26T14:21:57.207Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 194.920535] nixbot[2613]: {"ts": "2026-10-26T14:21:57.210Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 194.923609] nixbot[2613]: {"ts": "2026-10-26T14:21:57.213Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 194.927077] nixbot[2613]: {"ts": "2026-10-26T14:21:57.216Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 194.930053] nixbot[2613]: {"ts": "2026-10-26T14:21:57.220Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"} gitlab # [ 194.933216] nixbot[2613]: {"ts": "2026-10-26T14:21:57.223Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"} gitlab # [ 194.935685] nixbot[2613]: {"ts": "2026-10-26T14:21:57.225Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"} gitlab # [ 194.939400] nixbot[2613]: {"ts": "2026-10-26T14:21:57.228Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"} gitlab # [ 194.953805] nixbot[2613]: {"ts": "2026-10-26T14:21:57.243Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"} gitlab # [ 194.960949] nixbot[2613]: {"ts": "2026-10-26T14:21:57.251Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"} gitlab # [ 194.964791] nixbot[2613]: {"ts": "2026-10-26T14:21:57.255Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"} gitlab # [ 194.969397] nixbot[2613]: {"ts": "2026-10-26T14:21:57.259Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"} gitlab # [ 194.975986] nixbot[2613]: {"ts": "2026-10-26T14:21:57.266Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"} gitlab # [ 194.980196] nixbot[2613]: {"ts": "2026-10-26T14:21:57.270Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"} gitlab # [ 194.986624] nixbot[2613]: {"ts": "2026-10-26T14:21:57.276Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"} gitlab # [ 194.991504] nixbot[2613]: {"ts": "2026-10-26T14:21:57.281Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"} gitlab # [ 194.997292] nixbot[2613]: {"ts": "2026-10-26T14:21:57.287Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"} gitlab # [ 195.002081] nixbot[2613]: {"ts": "2026-10-26T14:21:57.292Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 38, "migration": "commit_statuses"} gitlab # [ 195.407897] nixbot[2613]: {"ts": "2026-10-26T14:21:57.698Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2613]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"} gitlab # [ 195.409406] nixbot[2613]: {"ts": "2026-10-26T14:21:57.698Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"} gitlab # [ 195.426786] nixbot[2613]: {"ts": "2026-10-26T14:21:57.716Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:46940 - \"GET /health HTTP/1.1\" 200"} gitlab # [ 195.432058] systemd[1]: Started nixbot CI service. gitlab # [ 195.432802] systemd[1]: Reached target Multi-User System. gitlab # [ 195.433685] systemd[1]: Startup finished in 1.219s (kernel) + 3.579s (initrd) + 3min 10.634s (userspace) = 3min 15.433s. gitlab # [ 195.611267] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:57 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 183 gitlab # [ 195.639682] nixbot[2613]: {"ts": "2026-10-26T14:21:57.929Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 195.699760] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 44 gitlab # [ 195.704500] nixbot[2613]: {"ts": "2026-10-26T14:21:57.993Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 195.875356] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 169 gitlab: (finished: waiting for unit nixbot.service, in 2.11 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 196.001317] nixbot[2613]: {"ts": "2026-10-26T14:21:58.290Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:46950 - \"GET /health HTTP/1.1\" 200"} gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 196.194927] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 151 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds) (finished: subtest: project discovered and webhook registered, in 0.19 seconds) subtest: push delivers the webhook gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails' gitlab # [ 196.636495] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:58 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 750 gitlab # [ 196.719623] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 71 gitlab # [ 196.789235] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:59 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 63 gitlab # [ 196.882413] gitaly[903]: time="2026-10-26T14:21:59.171Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DTXFGNWP1RHMV5VAW7H2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-26T14:22:29.053" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:21:59.154" grpc.time_ms=17.155 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 196.937122] gitaly[903]: time="2026-10-26T14:21:59.227Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DTXFGNWP1RHMV5VAW7H2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:22:29.125" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:21:59.225" grpc.time_ms=0.953 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 196.965117] gitaly[903]: time="2026-10-26T14:21:59.241Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DTXFGNWP1RHMV5VAW7H2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-26T14:22:09.150" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:21:59.231" grpc.time_ms=9.904 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 196.996659] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 196 gitlab # [ 197.100517] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 103 gitlab # [ 197.108433] nixbot[2613]: {"ts": "2026-10-26T14:21:59.398Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 197.271664] gitaly[903]: time="2026-10-26T14:21:59.561Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DV9VEYRJQ79F3S23D5T4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.544" grpc.time_ms=17.033 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.283652] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 78 gitlab # [ 197.397134] gitaly[903]: time="2026-10-26T14:21:59.687Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVCRGB533MJDE1MSE8FD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.674" pid=903 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 197.399295] gitaly[903]: time="2026-10-26T14:21:59.687Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVCRGB533MJDE1MSE8FD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.674" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.445890] gitaly[903]: time="2026-10-26T14:21:59.736Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVCRGB533MJDE1MSE8FD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.674" grpc.time_ms=13.467 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.447285] gitlab-workhorse[826]: time="2026-10-26T14:21:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 197.448750] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 160 gitlab # [ 197.535739] gitaly[903]: time="2026-10-26T14:21:59.825Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVHY49ZSZHS52KNRASGJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.806" pid=903 remote_ip="2001:db8:1::1" request_sha=22463d565a45195bc34b6e7821cf71790a491807 response_bytes=224 span.kind=server system=grpc gitlab # [ 197.536785] gitaly[903]: time="2026-10-26T14:21:59.825Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1209 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVHY49ZSZHS52KNRASGJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.806" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.537620] gitaly[903]: time="2026-10-26T14:21:59.826Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1209 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVHY49ZSZHS52KNRASGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.806" grpc.time_ms=19.982 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.538531] gitlab-workhorse[826]: time="2026-10-26T14:21:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=224 gitlab # [ 197.539153] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 84 gitlab # [ 197.646892] gitaly[903]: time="2026-10-26T14:21:59.937Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DVPRVSMDKNDC7V8PWET2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.927" grpc.time_ms=9.587 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.648988] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:21:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 41 gitlab # [ 197.715988] gitaly[903]: time="2026-10-26T14:22:00.006Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVRX7BN668TK00CESA4Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.998" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 197.736784] gitaly[903]: time="2026-10-26T14:22:00.006Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVRX7BN668TK00CESA4Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.998" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.755842] gitaly[903]: time="2026-10-26T14:22:00.006Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVRX7BN668TK00CESA4Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:21:59.998" grpc.time_ms=8.249 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.768571] gitlab-workhorse[826]: time="2026-10-26T14:22:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 197.770410] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 80 gitlab # [ 197.837552] gitaly[903]: time="2026-10-26T14:22:00.127Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DVWM2HPHPBCZMTAEFPJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:00.116" grpc.time_ms=10.887 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.860574] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:00 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 65 gitlab # [ 197.913605] gitaly[903]: time="2026-10-26T14:22:00.203Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVYSMBP2P5E7HP8DHH52 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:00.186" pid=903 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 197.915239] gitaly[903]: time="2026-10-26T14:22:00.203Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVYSMBP2P5E7HP8DHH52 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:00.186" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.916968] gitaly[903]: time="2026-10-26T14:22:00.203Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DVYSMBP2P5E7HP8DHH52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:00.186" grpc.time_ms=17.244 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.968853] gitlab-workhorse[826]: time="2026-10-26T14:22:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 197.970739] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 105 gitlab # [ 198.048414] gitaly[903]: time="2026-10-26T14:22:00.338Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:22:30.237" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:00.337" grpc.time_ms=0.727 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.120693] gitaly[903]: time="2026-10-26T14:22:00.410Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-26T14:22:30.300" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:00.401" grpc.time_ms=9.52 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.170340] gitaly[903]: time="2026-10-26T14:22:00.460Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:10.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:00.450" grpc.time_ms=9.566 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.195296] gitaly[903]: time="2026-10-26T14:22:00.472Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:10.025" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:00.466" grpc.time_ms=5.816 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.255433] gitaly[903]: time="2026-10-26T14:22:00.545Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T14:22:10.104" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:00.545" grpc.time_ms=0.433 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.297399] gitaly[903]: time="2026-10-26T14:22:00.587Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T14:22:10.136" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:00.576" grpc.time_ms=10.569 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.356406] gitaly[903]: time="2026-10-26T14:22:00.646Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:00.646" grpc.time_ms=0.547 pid=903 span.kind=server system=grpc gitlab # [ 198.392325] gitaly[903]: time="2026-10-26T14:22:00.682Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:00.681" grpc.time_ms=0.487 pid=903 span.kind=server system=grpc gitlab # [ 198.409136] gitaly[903]: time="2026-10-26T14:22:00.699Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 diskcache=e5dc57e7-0c7a-4c17-8a2d-aa534b42385d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T14:22:10.162" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:00.603" pid=903 ref=refs/keep-around/23a7074fb93b50049786134fe9da224ba53e02cb remote_ip="2001:db8:1::1" revision=23a7074fb93b50049786134fe9da224ba53e02cb span.kind=server system=grpc username=root gitlab # [ 198.419517] gitaly[903]: time="2026-10-26T14:22:00.709Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5294 command.oublock=8 command.real_time_ms=88 command.spawn_token_fork_ms=0 command.system_time_ms=48 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T14:22:10.162" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:00.603" grpc.time_ms=95.977 pid=903 ref=refs/keep-around/23a7074fb93b50049786134fe9da224ba53e02cb remote_ip="2001:db8:1::1" revision=23a7074fb93b50049786134fe9da224ba53e02cb span.kind=server system=grpc username=root gitlab # [ 198.435167] gitaly[903]: time="2026-10-26T14:22:00.725Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:22:30.624" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:00.724" grpc.time_ms=0.309 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.572879] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23a7074fb93b50049786134fe9da224ba53e02cb HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 563 gitlab # [ 198.586413] nixbot[2613]: {"ts": "2026-10-26T14:22:00.876Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-23a7074fb93b-0"} gitlab # [ 198.748183] nixbot[2613]: {"ts": "2026-10-26T14:22:01.038Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-23a7074fb93b-0", "argv0": "bwrap"} gitlab # [ 198.847768] systemd[1]: Started Nix Daemon. gitlab # [ 198.923716] nix-daemon[2782]: accepted connection from pid 2777, user nixbot gitlab # [ 203.191329] nix-daemon[2782]: accepted connection from pid 2824, user nixbot gitlab # [ 203.208365] nix-daemon[2782]: accepted connection from pid 2777, user nixbot gitlab # [ 208.218259] nix-daemon[2782]: accepted connection from pid 2777, user nixbot gitlab # [ 208.319651] nix-daemon[2782]: accepted connection from pid 2873, user nixbot gitlab # [ 208.346730] gitaly[903]: time="2026-10-26T14:22:10.636Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9E64THF9AJBRFK9SP4Y3B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:22:40.535" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:10.635" grpc.time_ms=0.557 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.389983] gitaly[903]: time="2026-10-26T14:22:10.680Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5W9E64THF9AJBRFK9SP4Y3B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:20.230" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:10.670" grpc.time_ms=9.728 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.452929] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23a7074fb93b50049786134fe9da224ba53e02cb HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 153 gitlab # [ 208.510970] gitaly[903]: time="2026-10-26T14:22:10.801Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9E6A3D8VDSHQ0MMV824V9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:22:40.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:10.800" grpc.time_ms=0.74 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.585190] gitaly[903]: time="2026-10-26T14:22:10.875Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9E6A3D8VDSHQ0MMV824V9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:20.088" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:10.869" grpc.time_ms=5.983 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.677689] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23a7074fb93b50049786134fe9da224ba53e02cb HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 211 gitlab # [ 211.974544] sidekiq-cluster[2488]: 2026-10-26T14:22:14.264Z pid=2488 tid=xsg INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2488, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>436981760} gitlab # [ 212.137744] sidekiq-cluster[2488]: W, [2026-10-26T14:22:14.427914 #2488] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 212.175792] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:14.465Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 213.372964] nix-daemon[2782]: accepted connection from pid 2950, user nixbot gitlab # [ 213.463817] gitaly[903]: time="2026-10-26T14:22:15.752Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9EB4NKK1YXD755B5FB7YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:22:45.650" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:15.751" grpc.time_ms=1.097 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.504874] gitaly[903]: time="2026-10-26T14:22:15.795Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9EB4NKK1YXD755B5FB7YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:25.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:15.788" grpc.time_ms=6.552 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.536735] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23a7074fb93b50049786134fe9da224ba53e02cb HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 124 gitlab # [ 213.716157] nixbot[2613]: {"ts": "2026-10-26T14:22:16.005Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "23a7074fb93b50049786134fe9da224ba53e02cb", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []} gitlab # [ 213.836889] gitaly[903]: time="2026-10-26T14:22:16.126Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5W9EBFVWN086JE7T3TMW9RB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:16.113" grpc.time_ms=13.352 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.838493] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 68 gitlab # [ 213.844696] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:16.134Z","message":"GitLab reliable fetch activated!"} gitlab # [ 213.846563] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:16.134Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 213.933924] gitaly[903]: time="2026-10-26T14:22:16.224Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9EBK89EKND5SVMMD9SF9V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:16.217" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 213.935685] gitaly[903]: time="2026-10-26T14:22:16.224Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9EBK89EKND5SVMMD9SF9V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:16.217" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.937248] gitlab-workhorse[826]: time="2026-10-26T14:22:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 213.938036] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 55 gitlab # [ 213.938804] gitaly[903]: time="2026-10-26T14:22:16.224Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9EBK89EKND5SVMMD9SF9V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:16.217" grpc.time_ms=7.155 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 214.049507] gitaly[903]: time="2026-10-26T14:22:16.339Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9EBQFT6ZV5H0SJZTB3KJ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:16.333" grpc.time_ms=5.959 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 214.050364] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 36 gitlab # [ 214.109927] gitaly[903]: time="2026-10-26T14:22:16.400Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9EBS22A5ATV0WZNG9A7E7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:16.391" pid=903 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 214.110969] gitaly[903]: time="2026-10-26T14:22:16.400Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9EBS22A5ATV0WZNG9A7E7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:16.391" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 214.111765] gitlab-workhorse[826]: time="2026-10-26T14:22:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 214.112620] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 46 gitlab # [ 214.113836] gitaly[903]: time="2026-10-26T14:22:16.402Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9EBS22A5ATV0WZNG9A7E7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:16.391" grpc.time_ms=9.374 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 232.772749] postgres[3155]: [3155] ERROR: relation "table_without_models" does not exist gitlab # [ 232.774713] postgres[3155]: [3155] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 235.078893] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:37.364Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 235.080475] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:37.365Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 235.081834] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:37.365Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 235.086178] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:37.365Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 235.086998] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:37.367Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 39.47 seconds) gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 235.753801] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:38 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 30 gitlab # [ 235.847794] gitaly[903]: time="2026-10-26T14:22:38.137Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F0YYDX4YTGHA06ZDPT7Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:38.126" grpc.time_ms=11.119 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 235.849076] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:38 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 91 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 137.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 236.060893] gitaly[903]: time="2026-10-26T14:22:38.350Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-26T14:23:08.243" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-26T14:22:38.344" grpc.time_ms=6.361 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 236.069603] gitaly[903]: time="2026-10-26T14:22:38.359Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5W9F12EA953J4YXB901NG5K duration_ms=52ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 236.100965] gitaly[903]: time="2026-10-26T14:22:38.391Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5W9F12EA953J4YXB901NG5K duration_ms=29ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 236.101938] gitaly[903]: time="2026-10-26T14:22:38.391Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:38.306" grpc.time_ms=85 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.140174] gitaly[903]: time="2026-10-26T14:22:38.430Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:38.429" grpc.time_ms=0.378 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.174825] gitaly[903]: time="2026-10-26T14:22:38.465Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:38.464" grpc.time_ms=0.262 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.202151] gitaly[903]: time="2026-10-26T14:22:38.492Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:38.492" grpc.time_ms=0.307 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.276121] gitaly[903]: time="2026-10-26T14:22:38.566Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5W9F12EA953J4YXB901NG5K duration_ms=47ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 236.284506] gitaly[903]: time="2026-10-26T14:22:38.566Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:38.518" grpc.time_ms=48.423 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.311629] gitaly[903]: time="2026-10-26T14:22:38.601Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K diskcache=2649b021-54f4-44b5-94b2-8154a64bc3a9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:38.227" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.326705] gitaly[903]: time="2026-10-26T14:22:38.616Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=195 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13559 command.oublock=32 command.real_time_ms=365 command.spawn_token_fork_ms=0 command.system_time_ms=125 command.user_time_ms=70 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:38.227" grpc.time_ms=374.162 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 236.338733] gitlab-workhorse[826]: time="2026-10-26T14:22:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 236.339619] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:38 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 470 gitlab # To http://gitlab/root/test-flake.git gitlab # 23a7074..e96e9bd master -> master gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.68 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81' gitlab # [ 236.393693] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:38.683Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"554720bcceed207119245a48","created_at":"2026-10-26T14:21:48.046Z","trace_propagation_headers":{"sentry-trace":"9e900b2cd4594ad188e840728302c5f8-52000423209a4e3f","baggage":"sentry-trace_id=9e900b2cd4594ad188e840728302c5f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DFEFH7VR59MHFWSWX03Q","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:48.077Z","job_size_bytes":2,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-554720bcceed207119245a48: start","job_status":"start","queue_duration_s":50.605126,"scheduling_latency_s":50.605161} gitlab # [ 236.414686] nixbot[2613]: {"ts": "2026-10-26T14:22:38.704Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53602 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81 HTTP/1.1\" 200"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81', in 0.06 seconds) gitlab # [ 236.530188] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:38.820Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"554720bcceed207119245a48","created_at":"2026-10-26T14:21:48.046Z","trace_propagation_headers":{"sentry-trace":"9e900b2cd4594ad188e840728302c5f8-52000423209a4e3f","baggage":"sentry-trace_id=9e900b2cd4594ad188e840728302c5f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DFEFH7VR59MHFWSWX03Q","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:48.077Z","job_size_bytes":2,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-554720bcceed207119245a48: done: 0.137146 sec","job_status":"done","queue_duration_s":50.605126,"scheduling_latency_s":50.605161,"redis_calls":25,"redis_duration_s":0.005213,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003018,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.063698878,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.137146,"completed_at":"2026-10-26T14:22:38.820Z","load_balancing_strategy":"primary","db_duration_s":0.034242,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.605292] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:38.895Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"a459c895203d1bda4ae6b7ae","created_at":"2026-10-26T14:21:48.085Z","trace_propagation_headers":{"sentry-trace":"9e900b2cd4594ad188e840728302c5f8-52000423209a4e3f","baggage":"sentry-trace_id=9e900b2cd4594ad188e840728302c5f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DFEFH7VR59MHFWSWX03Q","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:48.089Z","job_size_bytes":2,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-a459c895203d1bda4ae6b7ae: start","job_status":"start","queue_duration_s":50.806195,"scheduling_latency_s":50.806231} gitlab # [ 236.711765] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:39.001Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"a459c895203d1bda4ae6b7ae","created_at":"2026-10-26T14:21:48.085Z","trace_propagation_headers":{"sentry-trace":"9e900b2cd4594ad188e840728302c5f8-52000423209a4e3f","baggage":"sentry-trace_id=9e900b2cd4594ad188e840728302c5f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DFEFH7VR59MHFWSWX03Q","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:48.089Z","job_size_bytes":2,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-a459c895203d1bda4ae6b7ae: done: 0.106521 sec","job_status":"done","queue_duration_s":50.806195,"scheduling_latency_s":50.806231,"redis_calls":14,"redis_duration_s":0.0046300000000000004,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00137,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001935,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001325,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.076520899,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.106521,"completed_at":"2026-10-26T14:22:39.001Z","load_balancing_strategy":"primary","db_duration_s":0.024286,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.714643] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:39.003Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"da68a13c8d02a0dadeb68098","created_at":"2026-10-26T14:21:48.639Z","trace_propagation_headers":{"sentry-trace":"9e900b2cd4594ad188e840728302c5f8-52000423209a4e3f","baggage":"sentry-trace_id=9e900b2cd4594ad188e840728302c5f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DFEFH7VR59MHFWSWX03Q","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:48.649Z","job_size_bytes":5,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-da68a13c8d02a0dadeb68098: start","job_status":"start","queue_duration_s":50.353921,"scheduling_latency_s":50.353935} gitlab # [ 236.824628] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:39.114Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"da68a13c8d02a0dadeb68098","created_at":"2026-10-26T14:21:48.639Z","trace_propagation_headers":{"sentry-trace":"9e900b2cd4594ad188e840728302c5f8-52000423209a4e3f","baggage":"sentry-trace_id=9e900b2cd4594ad188e840728302c5f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DFEFH7VR59MHFWSWX03Q","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:48.649Z","job_size_bytes":5,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-da68a13c8d02a0dadeb68098: done: 0.111518 sec","job_status":"done","queue_duration_s":50.353921,"scheduling_latency_s":50.353935,"redis_calls":12,"redis_duration_s":0.002856,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000682,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001762,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000363174,"duration_s":0.111518,"completed_at":"2026-10-26T14:22:39.114Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024758,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.826503] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:39.115Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"1f4d88211109e434cc6e9ff9","created_at":"2026-10-26T14:21:48.681Z","trace_propagation_headers":{"sentry-trace":"9e900b2cd4594ad188e840728302c5f8-52000423209a4e3f","baggage":"sentry-trace_id=9e900b2cd4594ad188e840728302c5f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DFEFH7VR59MHFWSWX03Q","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:48.687Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-1f4d88211109e434cc6e9ff9: start","job_status":"start","queue_duration_s":50.42848,"scheduling_latency_s":50.428493} gitlab # [ 236.973376] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:39.263Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"1f4d88211109e434cc6e9ff9","created_at":"2026-10-26T14:21:48.681Z","trace_propagation_headers":{"sentry-trace":"9e900b2cd4594ad188e840728302c5f8-52000423209a4e3f","baggage":"sentry-trace_id=9e900b2cd4594ad188e840728302c5f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DFEFH7VR59MHFWSWX03Q","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:48.687Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-1f4d88211109e434cc6e9ff9: done: 0.147271 sec","job_status":"done","queue_duration_s":50.42848,"scheduling_latency_s":50.428493,"redis_calls":11,"redis_duration_s":0.002646,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000666,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001565,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.123,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.123,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000293613,"duration_s":0.147271,"completed_at":"2026-10-26T14:22:39.263Z","load_balancing_strategy":"primary","db_duration_s":0.068824,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.044725] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:39.265Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"feca68764a3d367fe06af549","created_at":"2026-10-26T14:21:48.691Z","trace_propagation_headers":{"sentry-trace":"9e900b2cd4594ad188e840728302c5f8-52000423209a4e3f","baggage":"sentry-trace_id=9e900b2cd4594ad188e840728302c5f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DFEFH7VR59MHFWSWX03Q","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:48.697Z","job_size_bytes":89,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-feca68764a3d367fe06af549: start","job_status":"start","queue_duration_s":50.567996,"scheduling_latency_s":50.568041} gitlab # [ 237.045529] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:39.300Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"feca68764a3d367fe06af549","created_at":"2026-10-26T14:21:48.691Z","trace_propagation_headers":{"sentry-trace":"9e900b2cd4594ad188e840728302c5f8-52000423209a4e3f","baggage":"sentry-trace_id=9e900b2cd4594ad188e840728302c5f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DFEFH7VR59MHFWSWX03Q","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-26T14:21:48.697Z","job_size_bytes":89,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-feca68764a3d367fe06af549: done: 0.034611 sec","job_status":"done","queue_duration_s":50.567996,"scheduling_latency_s":50.568041,"redis_calls":11,"redis_duration_s":0.003196,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00093,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001485,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000781,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000301435,"duration_s":0.034611,"completed_at":"2026-10-26T14:22:39.300Z","load_balancing_strategy":"primary","db_duration_s":0.005479,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.083971] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:39.301Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 23a7074fb93b50049786134fe9da224ba53e02cb refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4d2136d7dc5ce82976b45fe4","created_at":"2026-10-26T14:21:55.534Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-637f22a170814daf","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:55.538Z","job_size_bytes":185,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4d2136d7dc5ce82976b45fe4: start","job_status":"start","queue_duration_s":43.763275,"scheduling_latency_s":43.763288} gitlab # [ 237.084702] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:39.312Z","message":"changes: \"0000000000000000000000000000000000000000 23a7074fb93b50049786134fe9da224ba53e02cb refs/heads/master\\n\""} gitlab # [ 237.085461] gitaly[903]: time="2026-10-26T14:22:39.347Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:49.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:39.337" grpc.time_ms=9.888 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.087500] gitaly[903]: time="2026-10-26T14:22:39.364Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T14:22:49.024" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:39.355" grpc.time_ms=8.546 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.138645] gitaly[903]: time="2026-10-26T14:22:39.428Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-26T14:22:49.086" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:39.416" grpc.time_ms=11.971 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.183646] gitaly[903]: time="2026-10-26T14:22:39.473Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:39.473" grpc.time_ms=0.335 pid=903 span.kind=server system=grpc gitlab # [ 237.218618] gitaly[903]: time="2026-10-26T14:22:39.508Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:39.507" grpc.time_ms=1.504 pid=903 span.kind=server system=grpc gitlab # [ 237.238417] gitaly[903]: time="2026-10-26T14:22:39.528Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 diskcache=3527b28d-da5b-4491-8b43-65f7ce99d6b0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T14:22:49.107" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:39.437" pid=903 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 237.239673] gitaly[903]: time="2026-10-26T14:22:39.528Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=76 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5128 command.oublock=8 command.real_time_ms=82 command.spawn_token_fork_ms=0 command.system_time_ms=48 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T14:22:49.107" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:39.437" grpc.time_ms=90.817 pid=903 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 237.248860] gitaly[903]: time="2026-10-26T14:22:39.539Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-26T14:22:49.208" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:39.538" grpc.time_ms=0.098 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.279374] gitaly[903]: time="2026-10-26T14:22:39.569Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=943 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-26T14:22:49.231" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:39.562" grpc.time_ms=7.399 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.339387] gitaly[903]: time="2026-10-26T14:22:39.629Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-26T14:23:09.022" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:39.622" grpc.time_ms=6.829 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.390545] gitaly[903]: time="2026-10-26T14:22:39.680Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T14:22:49.009" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:39.680" grpc.time_ms=0.429 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81' gitlab # [ 237.421492] gitaly[903]: time="2026-10-26T14:22:39.711Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-26T14:22:49.034" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-26T14:22:39.704" grpc.time_ms=7.064 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.448686] gitaly[903]: time="2026-10-26T14:22:39.738Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:49.058" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:39.728" grpc.time_ms=9.437 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.467335] nixbot[2613]: {"ts": "2026-10-26T14:22:39.756Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53614 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81 HTTP/1.1\" 200"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81', in 0.05 seconds) gitlab # [ 237.470798] gitaly[903]: time="2026-10-26T14:22:39.760Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:49.080" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:39.751" grpc.time_ms=9.798 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.496741] gitaly[903]: time="2026-10-26T14:22:39.786Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-26T14:23:09.172" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:39.773" grpc.time_ms=13.72 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.819841] gitaly[903]: time="2026-10-26T14:22:40.109Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-26T14:22:50.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:40.108" grpc.time_ms=1.457 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.859289] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.148Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 23a7074fb93b50049786134fe9da224ba53e02cb refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4d2136d7dc5ce82976b45fe4","created_at":"2026-10-26T14:21:55.534Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-637f22a170814daf","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:21:55.538Z","job_size_bytes":185,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4d2136d7dc5ce82976b45fe4: done: 0.84703 sec","job_status":"done","queue_duration_s":43.763275,"scheduling_latency_s":43.763288,"gitaly_calls":13,"gitaly_duration_s":0.267311,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.040750999999999996,"redis_read_bytes":2103,"redis_write_bytes":21748,"redis_cache_calls":15,"redis_cache_duration_s":0.003619,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006238,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001559,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7836,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002715,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.014869,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.011751,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.163,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.183,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.481883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000473803,"exclusive_lock_hold_duration_s":0.02975881,"duration_s":0.84703,"completed_at":"2026-10-26T14:22:40.148Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.083211,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 237.921797] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.150Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"0f599b1e88cee46ca53e27ce","created_at":"2026-10-26T14:22:00.745Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-c8b6fc61a52e4b95","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:00.753Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-0f599b1e88cee46ca53e27ce: start","job_status":"start","queue_duration_s":39.397317,"scheduling_latency_s":39.397356} gitlab # [ 237.935071] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.225Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"0f599b1e88cee46ca53e27ce","created_at":"2026-10-26T14:22:00.745Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-c8b6fc61a52e4b95","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:00.753Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-0f599b1e88cee46ca53e27ce: done: 0.074695 sec","job_status":"done","queue_duration_s":39.397317,"scheduling_latency_s":39.397356,"redis_calls":16,"redis_duration_s":0.0043089999999999995,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002204,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000294451,"duration_s":0.074695,"completed_at":"2026-10-26T14:22:40.225Z","load_balancing_strategy":"primary","db_duration_s":0.017456,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 237.974768] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.226Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"721633a14fac2c59c9b82ae4","created_at":"2026-10-26T14:22:00.754Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-c8b6fc61a52e4b95","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:00.758Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-721633a14fac2c59c9b82ae4: start","job_status":"start","queue_duration_s":39.46755,"scheduling_latency_s":39.467563} gitlab # [ 238.023351] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.312Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"721633a14fac2c59c9b82ae4","created_at":"2026-10-26T14:22:00.754Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-c8b6fc61a52e4b95","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:00.758Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-721633a14fac2c59c9b82ae4: done: 0.086329 sec","job_status":"done","queue_duration_s":39.46755,"scheduling_latency_s":39.467563,"redis_calls":21,"redis_duration_s":0.00487,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002024,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001427,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000430781,"duration_s":0.086329,"completed_at":"2026-10-26T14:22:40.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.025462] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.315Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"988747914de3d3af501ef6ea","created_at":"2026-10-26T14:22:00.847Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-c8b6fc61a52e4b95","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:00.851Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-988747914de3d3af501ef6ea: start","job_status":"start","queue_duration_s":39.463718,"scheduling_latency_s":39.463748} gitlab # [ 238.176870] gitaly[903]: time="2026-10-26T14:22:40.466Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:40.466" grpc.time_ms=0.383 pid=903 span.kind=server system=grpc gitlab # [ 238.233754] gitaly[903]: time="2026-10-26T14:22:40.523Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:40.523" grpc.time_ms=0.717 pid=903 span.kind=server system=grpc gitlab # [ 238.290545] gitaly[903]: time="2026-10-26T14:22:40.580Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:40.579" grpc.time_ms=0.691 pid=903 span.kind=server system=grpc gitlab # [ 238.318827] gitaly[903]: time="2026-10-26T14:22:40.609Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 diskcache=2d19b777-567c-44e5-82fd-5d6c793d2b3a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T14:23:10.026" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:40.426" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.319948] gitaly[903]: time="2026-10-26T14:22:40.609Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=163 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7529 command.oublock=0 command.real_time_ms=172 command.spawn_token_fork_ms=0 command.system_time_ms=104 command.user_time_ms=59 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T14:23:10.026" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:40.426" grpc.time_ms=182.442 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81' gitlab # [ 238.471971] gitaly[903]: time="2026-10-26T14:22:40.762Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T14:23:10.160" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:40.760" grpc.time_ms=1.121 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81', in 0.04 seconds) gitlab # [ 238.502973] gitaly[903]: time="2026-10-26T14:22:40.793Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DW3B4E6VWJ64M48P6Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:10.191" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:40.792" grpc.time_ms=0.869 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.512552] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.802Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"988747914de3d3af501ef6ea","created_at":"2026-10-26T14:22:00.847Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-c8b6fc61a52e4b95","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:00.851Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2488,"job_status":"rescheduled","message":"PipelineProcessWorker JID-988747914de3d3af501ef6ea: rescheduled"} gitlab # [ 238.515808] nixbot[2613]: {"ts": "2026-10-26T14:22:40.803Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53628 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81 HTTP/1.1\" 200"} gitlab # [ 238.527859] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.816Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"988747914de3d3af501ef6ea","created_at":"2026-10-26T14:22:00.847Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-c8b6fc61a52e4b95","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:00.851Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-988747914de3d3af501ef6ea: done: 0.501747 sec","job_status":"done","queue_duration_s":39.463718,"scheduling_latency_s":39.463748,"gitaly_calls":3,"gitaly_duration_s":0.193267,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.028686,"redis_read_bytes":460,"redis_write_bytes":29292,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001282,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001089,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010055,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003681,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15579,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007631,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000567,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000586,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002513,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.017,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.02,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.210793,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.436632309,"duration_s":0.501747,"completed_at":"2026-10-26T14:22:40.816Z","load_balancing_strategy":"primary","db_duration_s":0.071535,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.578780] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.819Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","23a7074fb93b50049786134fe9da224ba53e02cb e96e9bd0e484012958fa71498bcd8397ab353f81 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"408fe4059ad1ab9558248c48","created_at":"2026-10-26T14:22:38.540Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-1db728b58cb540e9","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:22:38.542Z","job_size_bytes":185,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-408fe4059ad1ab9558248c48: start","job_status":"start","queue_duration_s":2.277393,"scheduling_latency_s":2.277425} gitlab # [ 238.579591] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.833Z","message":"changes: \"23a7074fb93b50049786134fe9da224ba53e02cb e96e9bd0e484012958fa71498bcd8397ab353f81 refs/heads/master\\n\""} gitlab # [ 238.580097] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.863Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"086aa1a1a5e31ba9243aecc1","created_at":"2026-10-26T14:22:40.862Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-92f7866ddedc4a67","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"f5fdbd5992d0d118c741f274","job_size_bytes":46,"pid":2488,"job_status":"deduplicated","message":"ProjectCacheWorker JID-086aa1a1a5e31ba9243aecc1: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 238.622312] gitaly[903]: time="2026-10-26T14:22:40.854Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:50.178" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:40.849" grpc.time_ms=5.323 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.622938] gitaly[903]: time="2026-10-26T14:22:40.861Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-26T14:22:50.186" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:40.857" grpc.time_ms=4.298 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.623554] gitaly[903]: time="2026-10-26T14:22:40.876Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-26T14:22:50.200" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:40.871" grpc.time_ms=5.692 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.624227] gitaly[903]: time="2026-10-26T14:22:40.885Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-26T14:23:10.279" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:40.879" grpc.time_ms=5.205 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.636965] gitaly[903]: time="2026-10-26T14:22:40.894Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=347 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-26T14:22:50.220" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-26T14:22:40.890" grpc.time_ms=3.143 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.679498] gitaly[903]: time="2026-10-26T14:22:40.905Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:50.230" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:40.901" grpc.time_ms=4.748 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.680188] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.964Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","23a7074fb93b50049786134fe9da224ba53e02cb e96e9bd0e484012958fa71498bcd8397ab353f81 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"408fe4059ad1ab9558248c48","created_at":"2026-10-26T14:22:38.540Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-1db728b58cb540e9","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-26T14:22:38.542Z","job_size_bytes":185,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-408fe4059ad1ab9558248c48: done: 0.145165 sec","job_status":"done","queue_duration_s":2.277393,"scheduling_latency_s":2.277425,"gitaly_calls":7,"gitaly_duration_s":0.040458,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.013236,"redis_read_bytes":501,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.001526,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000747,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001579,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.004634,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.00475,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000637232,"exclusive_lock_hold_duration_s":0.011768256,"duration_s":0.145165,"completed_at":"2026-10-26T14:22:40.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016567,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.719982] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:40.965Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"f5fdbd5992d0d118c741f274","created_at":"2026-10-26T14:22:39.367Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-3d5126a05c384cb0","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:39.390Z","job_size_bytes":46,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f5fdbd5992d0d118c741f274: start","job_status":"start","queue_duration_s":1.575489,"scheduling_latency_s":1.575504} gitlab # [ 238.720795] gitaly[903]: time="2026-10-26T14:22:40.954Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-26T14:22:50.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:40.953" grpc.time_ms=0.724 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.759862] gitaly[903]: time="2026-10-26T14:22:40.998Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-26T20:22:40.995" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:40.996" grpc.time_ms=2.052 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.760658] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:41.027Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"f5fdbd5992d0d118c741f274","created_at":"2026-10-26T14:22:39.367Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-3d5126a05c384cb0","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:39.390Z","job_size_bytes":46,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f5fdbd5992d0d118c741f274: done: 0.062017 sec","job_status":"done","queue_duration_s":1.575489,"scheduling_latency_s":1.575504,"gitaly_calls":2,"gitaly_duration_s":0.010578,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.0070480000000000004,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002716,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000331,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001521,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001895,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243606,"duration_s":0.062017,"completed_at":"2026-10-26T14:22:41.027Z","load_balancing_strategy":"primary","db_duration_s":0.012557,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.800704] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:41.028Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"8e64df88872ec53c2186aba7","created_at":"2026-10-26T14:22:39.406Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-3d5126a05c384cb0","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:39.411Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-8e64df88872ec53c2186aba7: start","job_status":"start","queue_duration_s":1.617099,"scheduling_latency_s":1.617112} gitlab # [ 238.801534] gitaly[903]: time="2026-10-26T14:22:41.009Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-26T14:23:11.003" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:41.003" grpc.time_ms=5.509 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.853982] gitaly[903]: time="2026-10-26T14:22:41.144Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 diskcache=fd687485-637d-481c-83d8-3551ecf782af grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-26T20:22:41.043" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:41.044" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.854705] gitaly[903]: time="2026-10-26T14:22:41.144Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1289 command.oublock=0 command.real_time_ms=101 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-26T20:22:41.043" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:41.044" grpc.time_ms=100.326 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.889515] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:41.178Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"8e64df88872ec53c2186aba7","created_at":"2026-10-26T14:22:39.406Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-3d5126a05c384cb0","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:39.411Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-8e64df88872ec53c2186aba7: done: 0.149982 sec","job_status":"done","queue_duration_s":1.617099,"scheduling_latency_s":1.617112,"gitaly_calls":1,"gitaly_duration_s":0.102301,"redis_calls":15,"redis_duration_s":0.002786,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000337,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000506,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.018,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.134466253,"duration_s":0.149982,"completed_at":"2026-10-26T14:22:41.178Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.911101] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:41.180Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"682e9a236e7e34f26a712ec0","created_at":"2026-10-26T14:22:39.535Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-3d5126a05c384cb0","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:39.537Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-682e9a236e7e34f26a712ec0: start","job_status":"start","queue_duration_s":1.64307,"scheduling_latency_s":1.643084} gitlab # [ 238.953733] gitaly[903]: time="2026-10-26T14:22:41.243Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=42 command.spawn_token_fork_ms=34 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-26T14:23:11.198" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:41.199" grpc.time_ms=44.288 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.974549] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:41.264Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"682e9a236e7e34f26a712ec0","created_at":"2026-10-26T14:22:39.535Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-3d5126a05c384cb0","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:39.537Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-682e9a236e7e34f26a712ec0: done: 0.084098 sec","job_status":"done","queue_duration_s":1.64307,"scheduling_latency_s":1.643084,"gitaly_calls":1,"gitaly_duration_s":0.057953,"redis_calls":16,"redis_duration_s":0.003648,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000362,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001557,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000639,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.084098,"completed_at":"2026-10-26T14:22:41.264Z","load_balancing_strategy":"primary","db_duration_s":0.002362,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.976341] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:41.266Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"86d474d5498f5d6368431326","created_at":"2026-10-26T14:22:39.994Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-3d5126a05c384cb0","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6516636ca03cb7a4028442accc7829644fca4955f919c30de950c79296cfbde4","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:39.998Z","job_size_bytes":467,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-86d474d5498f5d6368431326: start","job_status":"start","queue_duration_s":1.26768,"scheduling_latency_s":1.2677} gitlab # [ 238.996668] gitaly[903]: time="2026-10-26T14:22:41.286Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:11.285" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:41.285" grpc.time_ms=0.783 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.053351] gitaly[903]: time="2026-10-26T14:22:41.343Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T14:22:51.233" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:41.333" grpc.time_ms=9.641 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.132277] gitaly[903]: time="2026-10-26T14:22:41.422Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T14:23:11.420" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:41.421" grpc.time_ms=1.214 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.157818] gitaly[903]: time="2026-10-26T14:22:41.428Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=30 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-26T14:23:11.424" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:41.424" grpc.time_ms=2.885 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.247746] gitaly[903]: time="2026-10-26T14:22:41.537Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:51.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:41.530" grpc.time_ms=6.777 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81' gitlab # [ 239.560806] nixbot[2613]: {"ts": "2026-10-26T14:22:41.850Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53636 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81 HTTP/1.1\" 200"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81', in 0.05 seconds) gitlab # [ 239.705249] gitaly[903]: time="2026-10-26T14:22:41.995Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-26T14:23:11.577" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:41.978" grpc.time_ms=16.937 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.757735] gitaly[903]: time="2026-10-26T14:22:42.047Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9DPBSE42A2YCPT3E9MN32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-26T14:23:12.031" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:42.032" grpc.time_ms=15.724 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.822231] sidekiq-cluster[2488]: {"severity":"WARN","time":"2026-10-26T14:22:42.112Z","class":"CreatePipelineWorker","correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"23a7074fb93b50049786134fe9da224ba53e02cb","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"23a7074fb93b50049786134fe9da224ba53e02cb","ref":"refs/heads/master"},"retry":0} gitlab # [ 239.832606] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.122Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"86d474d5498f5d6368431326","created_at":"2026-10-26T14:22:39.994Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-3d5126a05c384cb0","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6516636ca03cb7a4028442accc7829644fca4955f919c30de950c79296cfbde4","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:39.998Z","job_size_bytes":467,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-86d474d5498f5d6368431326: done: 0.856195 sec","job_status":"done","queue_duration_s":1.26768,"scheduling_latency_s":1.2677,"gitaly_calls":7,"gitaly_duration_s":0.158436,"redis_calls":51,"redis_duration_s":0.010903,"redis_read_bytes":169,"redis_write_bytes":4165,"redis_cache_calls":4,"redis_cache_duration_s":0.000913,"redis_cache_read_bytes":10,"redis_cache_write_bytes":340,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004475,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001503,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002715,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001297,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.591264,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000562362,"duration_s":0.856195,"completed_at":"2026-10-26T14:22:42.122Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.076063,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 239.848623] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.124Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"9eaa6eec-38ca-4243-b6b9-47c58b483863\"}"],"class":"WebHookWorker","jid":"5e5abb5988b3c69ebc24d376","created_at":"2026-10-26T14:22:40.085Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-3d5126a05c384cb0","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:51091abe189e8ac5850ab68f3e1f6b371da5017181bc0902a07697fbd55102f2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.089Z","job_size_bytes":1751,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-5e5abb5988b3c69ebc24d376: start","job_status":"start","queue_duration_s":2.034685,"scheduling_latency_s":2.034761} gitlab # [ 240.038355] nixbot[2613]: {"ts": "2026-10-26T14:22:42.328Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "0d3caeb1-ed75-4049-a081-3cff10a9a0e3", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "23a7074fb93b50049786134fe9da224ba53e02cb", "pr": null} gitlab # [ 240.043755] nixbot[2613]: {"ts": "2026-10-26T14:22:42.333Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53652 - \"POST /webhooks/gitlab HTTP/1.1\" 202"} gitlab # [ 240.069341] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.358Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"9eaa6eec-38ca-4243-b6b9-47c58b483863\"}"],"class":"WebHookWorker","jid":"5e5abb5988b3c69ebc24d376","created_at":"2026-10-26T14:22:40.085Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-3d5126a05c384cb0","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:51091abe189e8ac5850ab68f3e1f6b371da5017181bc0902a07697fbd55102f2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.089Z","job_size_bytes":1751,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-5e5abb5988b3c69ebc24d376: done: 0.233996 sec","job_status":"done","queue_duration_s":2.034685,"scheduling_latency_s":2.034761,"redis_calls":19,"redis_duration_s":0.005452,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001935,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000476,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002082,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.06337090400000989,"cpu_s":0.093556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042687,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.233996,"completed_at":"2026-10-26T14:22:42.358Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00355,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.141622] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.360Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d80f970442a110d31d43397c","created_at":"2026-10-26T14:22:40.415Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.418Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d80f970442a110d31d43397c: start","job_status":"start","queue_duration_s":1.942122,"scheduling_latency_s":1.942147} gitlab # [ 240.142603] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.418Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d80f970442a110d31d43397c","created_at":"2026-10-26T14:22:40.415Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.418Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d80f970442a110d31d43397c: done: 0.057572 sec","job_status":"done","queue_duration_s":1.942122,"scheduling_latency_s":1.942147,"redis_calls":10,"redis_duration_s":0.002017,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000328,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000310933,"duration_s":0.057572,"completed_at":"2026-10-26T14:22:42.418Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014606,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 240.182540] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.419Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"60b1ccda2a07aa907357997d","created_at":"2026-10-26T14:22:40.616Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.623Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-60b1ccda2a07aa907357997d: start","job_status":"start","queue_duration_s":1.796041,"scheduling_latency_s":1.796054} gitlab # [ 240.183177] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.442Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"60b1ccda2a07aa907357997d","created_at":"2026-10-26T14:22:40.616Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.623Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-60b1ccda2a07aa907357997d: done: 0.022973 sec","job_status":"done","queue_duration_s":1.796041,"scheduling_latency_s":1.796054,"redis_calls":10,"redis_duration_s":0.002272,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000405,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001487,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000271543,"duration_s":0.022973,"completed_at":"2026-10-26T14:22:42.442Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.211535] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.444Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"abd3bbb7fc13d4c2909d34ca","created_at":"2026-10-26T14:22:40.696Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.702Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-abd3bbb7fc13d4c2909d34ca: start","job_status":"start","queue_duration_s":1.741696,"scheduling_latency_s":1.741708} gitlab # [ 240.225578] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"abd3bbb7fc13d4c2909d34ca","created_at":"2026-10-26T14:22:40.696Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.702Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-abd3bbb7fc13d4c2909d34ca: done: 0.023263 sec","job_status":"done","queue_duration_s":1.741696,"scheduling_latency_s":1.741708,"redis_calls":10,"redis_duration_s":0.001944,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000388,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000327974,"duration_s":0.023263,"completed_at":"2026-10-26T14:22:42.467Z","load_balancing_strategy":"primary","db_duration_s":0.005299,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.284744] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9c6696b242e21acdb0d64996","created_at":"2026-10-26T14:22:40.713Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.716Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9c6696b242e21acdb0d64996: start","job_status":"start","queue_duration_s":1.751402,"scheduling_latency_s":1.751414} gitlab # [ 240.285511] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.527Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9c6696b242e21acdb0d64996","created_at":"2026-10-26T14:22:40.713Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.716Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9c6696b242e21acdb0d64996: done: 0.059216 sec","job_status":"done","queue_duration_s":1.751402,"scheduling_latency_s":1.751414,"redis_calls":13,"redis_duration_s":0.005786,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001536,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002536,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000997,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000717,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041374,"duration_s":0.059216,"completed_at":"2026-10-26T14:22:42.527Z","load_balancing_strategy":"primary","db_duration_s":0.011378,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.347084] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 63 gitlab # [ 240.347639] gitlab-workhorse[826]: time="2026-10-26T14:22:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 240.348385] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 73 gitlab # [ 240.349653] gitaly[903]: time="2026-10-26T14:22:42.541Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F59E8JDE1AJ28BHHGW3N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:42.535" grpc.time_ms=6.2 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.351042] gitaly[903]: time="2026-10-26T14:22:42.616Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F5BF52FQE2V66WZD2XAM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:42.578" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 240.351686] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.529Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"df12723a6822476198cbe8f5","created_at":"2026-10-26T14:22:40.717Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.720Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-df12723a6822476198cbe8f5: start","job_status":"start","queue_duration_s":1.808942,"scheduling_latency_s":1.808966} gitlab # [ 240.357230] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.553Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"df12723a6822476198cbe8f5","created_at":"2026-10-26T14:22:40.717Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.720Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-df12723a6822476198cbe8f5: done: 0.024295 sec","job_status":"done","queue_duration_s":1.808942,"scheduling_latency_s":1.808966,"redis_calls":10,"redis_duration_s":0.001299,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198908,"duration_s":0.024295,"completed_at":"2026-10-26T14:22:42.553Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.419035] gitaly[903]: time="2026-10-26T14:22:42.616Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=36 command.spawn_token_fork_ms=32 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F5BF52FQE2V66WZD2XAM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:42.578" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.419636] nixbot[2613]: {"ts": "2026-10-26T14:22:42.697Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 240.419908] nixbot[2613]: {"ts": "2026-10-26T14:22:42.699Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "23a7074fb93b50049786134fe9da224ba53e02cb"} gitlab # [ 240.420677] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.554Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1291055bd19d5d27f4b56086","created_at":"2026-10-26T14:22:40.721Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.724Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1291055bd19d5d27f4b56086: start","job_status":"start","queue_duration_s":1.830508,"scheduling_latency_s":1.83052} gitlab # [ 240.428432] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.573Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1291055bd19d5d27f4b56086","created_at":"2026-10-26T14:22:40.721Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.724Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1291055bd19d5d27f4b56086: done: 0.018797 sec","job_status":"done","queue_duration_s":1.830508,"scheduling_latency_s":1.83052,"redis_calls":11,"redis_duration_s":0.0016220000000000002,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000319035,"duration_s":0.018797,"completed_at":"2026-10-26T14:22:42.573Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.467514] gitlab-workhorse[826]: time="2026-10-26T14:22:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=342 gitlab # [ 240.468906] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 342 "" "git/2.55.0" 49 gitlab # [ 240.470609] gitaly[903]: time="2026-10-26T14:22:42.617Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=36 command.spawn_token_fork_ms=32 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F5BF52FQE2V66WZD2XAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:42.578" grpc.time_ms=38.952 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.483637] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.575Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"417dcced45777a7643bd913d","created_at":"2026-10-26T14:22:40.726Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.728Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-417dcced45777a7643bd913d: start","job_status":"start","queue_duration_s":1.846314,"scheduling_latency_s":1.846326} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81' gitlab # [ 240.499753] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.595Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"417dcced45777a7643bd913d","created_at":"2026-10-26T14:22:40.726Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.728Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-417dcced45777a7643bd913d: done: 0.019951 sec","job_status":"done","queue_duration_s":1.846314,"scheduling_latency_s":1.846326,"redis_calls":10,"redis_duration_s":0.001412,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214552,"duration_s":0.019951,"completed_at":"2026-10-26T14:22:42.595Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.541504] gitaly[903]: time="2026-10-26T14:22:42.667Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F5DVFYA99F4EB3DBCGPQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:42.656" pid=903 remote_ip="2001:db8:1::1" request_sha=d03fa5d1167a09b70dc9c6ab589d2a2ef9c7555c response_bytes=342 span.kind=server system=grpc gitlab # [ 240.547791] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.596Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"d9a9e4bee18e9663ded2ac1c","created_at":"2026-10-26T14:22:40.729Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.732Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d9a9e4bee18e9663ded2ac1c: start","job_status":"start","queue_duration_s":1.863922,"scheduling_latency_s":1.863935} gitlab # [ 240.584783] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.619Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"d9a9e4bee18e9663ded2ac1c","created_at":"2026-10-26T14:22:40.729Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.732Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d9a9e4bee18e9663ded2ac1c: done: 0.02335 sec","job_status":"done","queue_duration_s":1.863922,"scheduling_latency_s":1.863935,"redis_calls":10,"redis_duration_s":0.001322,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00081,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200305,"duration_s":0.02335,"completed_at":"2026-10-26T14:22:42.619Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.599593] gitaly[903]: time="2026-10-26T14:22:42.667Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F5DVFYA99F4EB3DBCGPQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:42.656" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.644272] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.620Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8afad80b65708ac3ad52208c","created_at":"2026-10-26T14:22:40.736Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.738Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8afad80b65708ac3ad52208c: start","job_status":"start","queue_duration_s":1.881731,"scheduling_latency_s":1.881744} gitlab # [ 240.644923] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.649Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8afad80b65708ac3ad52208c","created_at":"2026-10-26T14:22:40.736Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.738Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8afad80b65708ac3ad52208c: done: 0.029324 sec","job_status":"done","queue_duration_s":1.881731,"scheduling_latency_s":1.881744,"redis_calls":10,"redis_duration_s":0.001763,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00024,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001235,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027266,"duration_s":0.029324,"completed_at":"2026-10-26T14:22:42.649Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.686533] gitaly[903]: time="2026-10-26T14:22:42.668Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F5DVFYA99F4EB3DBCGPQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:42.656" grpc.time_ms=12.097 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.687510] nixbot[2613]: {"ts": "2026-10-26T14:22:42.967Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53662 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81 HTTP/1.1\" 200"} gitlab # [ 240.688151] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"048ea82782bfee7452b583e4","created_at":"2026-10-26T14:22:40.739Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.741Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-048ea82782bfee7452b583e4: start","job_status":"start","queue_duration_s":1.909335,"scheduling_latency_s":1.909348} gitlab # [ 240.727945] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.667Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"048ea82782bfee7452b583e4","created_at":"2026-10-26T14:22:40.739Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.741Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-048ea82782bfee7452b583e4: done: 0.016208 sec","job_status":"done","queue_duration_s":1.909335,"scheduling_latency_s":1.909348,"redis_calls":10,"redis_duration_s":0.002104,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001585,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00018913,"duration_s":0.016208,"completed_at":"2026-10-26T14:22:42.667Z","load_balancing_strategy":"primary","db_duration_s":0.001314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.767209] gitaly[903]: time="2026-10-26T14:22:42.748Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F5GP5C0MM40FAG9CSW76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:12.646" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:42.747" grpc.time_ms=0.503 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.767835] gitaly[903]: time="2026-10-26T14:22:42.782Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K diskcache=09610b4e-3589-4fd2-9267-aa0de1f33945 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-26T20:22:42.770" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:42.770" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.768539] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.668Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3424a9533440e7d35398833f","created_at":"2026-10-26T14:22:40.742Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.744Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3424a9533440e7d35398833f: start","job_status":"start","queue_duration_s":1.923546,"scheduling_latency_s":1.923596} gitlab # [ 240.769194] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.692Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3424a9533440e7d35398833f","created_at":"2026-10-26T14:22:40.742Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.744Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3424a9533440e7d35398833f: done: 0.023614 sec","job_status":"done","queue_duration_s":1.923546,"scheduling_latency_s":1.923596,"redis_calls":10,"redis_duration_s":0.001425,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000872,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229638,"duration_s":0.023614,"completed_at":"2026-10-26T14:22:42.692Z","load_balancing_strategy":"primary","db_duration_s":0.004856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.820671] gitaly[903]: time="2026-10-26T14:22:42.782Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-26T20:22:42.770" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:42.770" grpc.time_ms=11.574 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.821478] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.693Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"cd9103e962e91bed60c2236f","created_at":"2026-10-26T14:22:40.749Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.752Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-cd9103e962e91bed60c2236f: start","job_status":"start","queue_duration_s":1.94095,"scheduling_latency_s":1.940963} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81', in 0.33 seconds) gitlab # [ 240.859959] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.739Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"cd9103e962e91bed60c2236f","created_at":"2026-10-26T14:22:40.749Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.752Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-cd9103e962e91bed60c2236f: done: 0.046277 sec","job_status":"done","queue_duration_s":1.94095,"scheduling_latency_s":1.940963,"redis_calls":14,"redis_duration_s":0.002539,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000325,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001114,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218464,"duration_s":0.046277,"completed_at":"2026-10-26T14:22:42.739Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.868669] gitaly[903]: time="2026-10-26T14:22:42.809Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:12.808" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:42.809" grpc.time_ms=0.419 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.879870] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.740Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"082d3a18ebd3c5bbee41c553","created_at":"2026-10-26T14:22:40.802Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.805Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-082d3a18ebd3c5bbee41c553: start","job_status":"start","queue_duration_s":1.935044,"scheduling_latency_s":1.935057} gitlab # [ 240.918634] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.756Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"082d3a18ebd3c5bbee41c553","created_at":"2026-10-26T14:22:40.802Z","trace_propagation_headers":{"sentry-trace":"3c72585f67264616b715e6a821b5b0e7-4f326654a58a490c","baggage":"sentry-trace_id=3c72585f67264616b715e6a821b5b0e7,sentry-release=Unknown"},"correlation_id":"01M5W9DW3B4E6VWJ64M48P6Z60","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.805Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-082d3a18ebd3c5bbee41c553: done: 0.016522 sec","job_status":"done","queue_duration_s":1.935044,"scheduling_latency_s":1.935057,"redis_calls":8,"redis_duration_s":0.001078,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016522,"completed_at":"2026-10-26T14:22:42.756Z","load_balancing_strategy":"primary","db_duration_s":0.002471,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 240.960709] gitaly[903]: time="2026-10-26T14:22:42.816Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T14:22:52.000" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:42.811" grpc.time_ms=5.085 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.961567] nixbot[2613]: {"ts": "2026-10-26T14:22:43.248Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "6b4f07f0-a293-49ba-8469-e76d5fa6005e", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "e96e9bd0e484012958fa71498bcd8397ab353f81", "pr": null} gitlab # [ 240.962093] nixbot[2613]: {"ts": "2026-10-26T14:22:43.250Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53664 - \"POST /webhooks/gitlab HTTP/1.1\" 202"} gitlab # [ 240.962626] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.757Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"186b5fc764e429fdaa0264ac","created_at":"2026-10-26T14:22:40.867Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-92f7866ddedc4a67","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"8e64df88872ec53c2186aba7","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.868Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-186b5fc764e429fdaa0264ac: start","job_status":"start","queue_duration_s":1.889292,"scheduling_latency_s":1.889305} gitlab # [ 240.963545] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.794Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"186b5fc764e429fdaa0264ac","created_at":"2026-10-26T14:22:40.867Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-92f7866ddedc4a67","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"8e64df88872ec53c2186aba7","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.868Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-186b5fc764e429fdaa0264ac: done: 0.037236 sec","job_status":"done","queue_duration_s":1.889292,"scheduling_latency_s":1.889305,"gitaly_calls":1,"gitaly_duration_s":0.014688,"redis_calls":12,"redis_duration_s":0.001526,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00032,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00057,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.026765413,"duration_s":0.037236,"completed_at":"2026-10-26T14:22:42.794Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007831,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.043606] gitaly[903]: time="2026-10-26T14:22:42.837Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T14:23:12.836" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:42.836" grpc.time_ms=0.462 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.044593] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23a7074fb93b50049786134fe9da224ba53e02cb HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 554 gitlab # [ 241.045615] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:42.795Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"54d7a12f40d431c74a12ebdb","created_at":"2026-10-26T14:22:40.934Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-92f7866ddedc4a67","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:30f4ce6ff8d8213ebbe3db4c0bb207d4d5c8f53d2bd4102d1d9a24d48e6099b7","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.935Z","job_size_bytes":467,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-54d7a12f40d431c74a12ebdb: start","job_status":"start","queue_duration_s":1.860387,"scheduling_latency_s":1.860399} gitlab # [ 241.045942] sidekiq-cluster[2488]: {"severity":"WARN","time":"2026-10-26T14:22:43.227Z","class":"CreatePipelineWorker","correlation_id":"01M5W9F12EA953J4YXB901NG5K","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"23a7074fb93b50049786134fe9da224ba53e02cb","after":"e96e9bd0e484012958fa71498bcd8397ab353f81","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e96e9bd0e484012958fa71498bcd8397ab353f81","ref":"refs/heads/master"},"retry":0} gitlab # [ 241.047900] gitaly[903]: time="2026-10-26T14:22:42.840Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=43 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-26T14:23:12.839" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:42.839" grpc.time_ms=1.246 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.053682] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.230Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"54d7a12f40d431c74a12ebdb","created_at":"2026-10-26T14:22:40.934Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-92f7866ddedc4a67","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:30f4ce6ff8d8213ebbe3db4c0bb207d4d5c8f53d2bd4102d1d9a24d48e6099b7","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.935Z","job_size_bytes":467,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-54d7a12f40d431c74a12ebdb: done: 0.434545 sec","job_status":"done","queue_duration_s":1.860387,"scheduling_latency_s":1.860399,"gitaly_calls":7,"gitaly_duration_s":0.04221,"redis_calls":33,"redis_duration_s":0.003107,"redis_read_bytes":183,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000494,"redis_cache_read_bytes":42,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001321,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000615,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.377432,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.434545,"completed_at":"2026-10-26T14:22:43.230Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010656,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.096266] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.232Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"248dd33a-ab39-490f-8070-bf75961ab39f\"}"],"class":"WebHookWorker","jid":"fb2165a9646816999eaec383","created_at":"2026-10-26T14:22:40.944Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-92f7866ddedc4a67","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:84bac7b3bf9721c7b6b3f992c376b37c9c30a8c25b83dd51fcf2c29309668ca0","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.945Z","job_size_bytes":1749,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-fb2165a9646816999eaec383: start","job_status":"start","queue_duration_s":2.286427,"scheduling_latency_s":2.286443} gitlab # [ 241.139601] gitaly[903]: time="2026-10-26T14:22:42.858Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:52.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:42.854" grpc.time_ms=4.903 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.140398] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 125 gitlab # [ 241.140836] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.256Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"248dd33a-ab39-490f-8070-bf75961ab39f\"}"],"class":"WebHookWorker","jid":"fb2165a9646816999eaec383","created_at":"2026-10-26T14:22:40.944Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-92f7866ddedc4a67","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:84bac7b3bf9721c7b6b3f992c376b37c9c30a8c25b83dd51fcf2c29309668ca0","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:40.945Z","job_size_bytes":1749,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-fb2165a9646816999eaec383: done: 0.024801 sec","job_status":"done","queue_duration_s":2.286427,"scheduling_latency_s":2.286443,"redis_calls":14,"redis_duration_s":0.002145,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000796,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.004773510999996233,"cpu_s":0.014307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.024801,"completed_at":"2026-10-26T14:22:43.256Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.181487] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.257Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"23229d0fcfe1c8362689865e","created_at":"2026-10-26T14:22:41.017Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-6145ad0cdda34071","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:41.020Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-23229d0fcfe1c8362689865e: start","job_status":"start","queue_duration_s":2.237186,"scheduling_latency_s":2.237199} gitlab # [ 241.182297] gitaly[903]: time="2026-10-26T14:22:43.206Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-26T14:23:13.196" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:43.196" grpc.time_ms=9.326 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.195474] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.297Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"23229d0fcfe1c8362689865e","created_at":"2026-10-26T14:22:41.017Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-6145ad0cdda34071","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:41.020Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-23229d0fcfe1c8362689865e: done: 0.039314 sec","job_status":"done","queue_duration_s":2.237186,"scheduling_latency_s":2.237199,"redis_calls":19,"redis_duration_s":0.00436,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000601,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000329,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002372,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006972394,"duration_s":0.039314,"completed_at":"2026-10-26T14:22:43.297Z","load_balancing_strategy":"primary","db_duration_s":0.007902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.242347] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.298Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","5e5abb5988b3c69ebc24d376"],"class":"WebHooks::LogExecutionWorker","jid":"418e1d83aa41b11f3621288e","created_at":"2026-10-26T14:22:42.338Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-e03d95373fd64331","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9ff5030b48447e2ca401025bb01865bf0221f8c2bf9e6fc19d29a89be5f36b47","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:42.348Z","job_size_bytes":2593,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-418e1d83aa41b11f3621288e: start","job_status":"start","queue_duration_s":0.949522,"scheduling_latency_s":0.949534} gitlab # [ 241.284883] gitaly[903]: time="2026-10-26T14:22:43.218Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F12EA953J4YXB901NG5K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-26T14:23:13.209" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:43.210" grpc.time_ms=8.295 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.285685] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.333Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","5e5abb5988b3c69ebc24d376"],"class":"WebHooks::LogExecutionWorker","jid":"418e1d83aa41b11f3621288e","created_at":"2026-10-26T14:22:42.338Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-e03d95373fd64331","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9ff5030b48447e2ca401025bb01865bf0221f8c2bf9e6fc19d29a89be5f36b47","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:42.348Z","job_size_bytes":2593,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-418e1d83aa41b11f3621288e: done: 0.034947 sec","job_status":"done","queue_duration_s":0.949522,"scheduling_latency_s":0.949534,"redis_calls":10,"redis_duration_s":0.0023279999999999998,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001468,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222654,"duration_s":0.034947,"completed_at":"2026-10-26T14:22:43.333Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012661,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.324666] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.337Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"da4e8841ff366291548e53ab","created_at":"2026-10-26T14:22:43.246Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-e92822fb06d84386","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.248Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-da4e8841ff366291548e53ab: start","job_status":"start","queue_duration_s":0.088746,"scheduling_latency_s":0.088759} gitlab # [ 241.325509] gitaly[903]: time="2026-10-26T14:22:43.227Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F5GP5C0MM40FAG9CSW76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:53.142" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:43.222" grpc.time_ms=5.131 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.326893] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23a7074fb93b50049786134fe9da224ba53e02cb HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 338 gitlab # [ 241.329177] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.510Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"da4e8841ff366291548e53ab","created_at":"2026-10-26T14:22:43.246Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-e92822fb06d84386","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.248Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-da4e8841ff366291548e53ab: done: 0.17378 sec","job_status":"done","queue_duration_s":0.088746,"scheduling_latency_s":0.088759,"gitaly_calls":3,"gitaly_duration_s":0.07257,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009013,"redis_read_bytes":143,"redis_write_bytes":16714,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000662,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000547,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001613,"redis_queues_read_bytes":23,"redis_queues_write_bytes":11220,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.003695,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000226,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00032,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001288,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073674,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1487812,"duration_s":0.17378,"completed_at":"2026-10-26T14:22:43.510Z","load_balancing_strategy":"primary","db_duration_s":0.019626,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.382323] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.512Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","fb2165a9646816999eaec383"],"class":"WebHooks::LogExecutionWorker","jid":"ea33b796ab315046cce29f90","created_at":"2026-10-26T14:22:43.251Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-274131895e9a4ed9","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d022b4939d0e548643d8373a67b4db09a46d347c5dfc2aa387d9a859bd8659cb","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.252Z","job_size_bytes":2591,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-ea33b796ab315046cce29f90: start","job_status":"start","queue_duration_s":0.25917,"scheduling_latency_s":0.259279} gitlab # [ 241.393331] gitaly[903]: time="2026-10-26T14:22:43.309Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F62AHPJRBKQSBWMMYWHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:13.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:43.309" grpc.time_ms=0.44 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.401676] gitaly[903]: time="2026-10-26T14:22:43.406Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F5GP5C0MM40FAG9CSW76 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:43.406" grpc.time_ms=0.323 pid=903 span.kind=server system=grpc gitlab # [ 241.411456] gitlab-workhorse[826]: time="2026-10-26T14:22:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 241.413311] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 217 gitlab # [ 241.413856] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.527Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","fb2165a9646816999eaec383"],"class":"WebHooks::LogExecutionWorker","jid":"ea33b796ab315046cce29f90","created_at":"2026-10-26T14:22:43.251Z","trace_propagation_headers":{"sentry-trace":"88268bb0a98d4c3e8aa5efbf61dd93a0-274131895e9a4ed9","baggage":"sentry-trace_id=88268bb0a98d4c3e8aa5efbf61dd93a0,sentry-release=Unknown"},"correlation_id":"01M5W9F12EA953J4YXB901NG5K","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d022b4939d0e548643d8373a67b4db09a46d347c5dfc2aa387d9a859bd8659cb","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.252Z","job_size_bytes":2591,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-ea33b796ab315046cce29f90: done: 0.015708 sec","job_status":"done","queue_duration_s":0.25917,"scheduling_latency_s":0.259279,"redis_calls":7,"redis_duration_s":0.000868,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015708,"completed_at":"2026-10-26T14:22:43.527Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.459559] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.528Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"59924ee0626be3e4fb9b1d2b","created_at":"2026-10-26T14:22:43.285Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-09c2ef5207024100","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.290Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-59924ee0626be3e4fb9b1d2b: start","job_status":"start","queue_duration_s":0.23812,"scheduling_latency_s":0.238133} gitlab # [ 241.465561] gitaly[903]: time="2026-10-26T14:22:43.415Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F62S13G1P456W9W4PTN3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.410" grpc.time_ms=4.98 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 241.477103] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 60 gitlab # [ 241.479057] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.592Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"59924ee0626be3e4fb9b1d2b","created_at":"2026-10-26T14:22:43.285Z","trace_propagation_headers":{"sentry-trace":"00014b487ab146668896a9223629dfb1-09c2ef5207024100","baggage":"sentry-trace_id=00014b487ab146668896a9223629dfb1,sentry-release=Unknown"},"correlation_id":"01M5W9DPBSE42A2YCPT3E9MN32","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.290Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-59924ee0626be3e4fb9b1d2b: done: 0.064289 sec","job_status":"done","queue_duration_s":0.23812,"scheduling_latency_s":0.238133,"redis_calls":11,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000199187,"duration_s":0.064289,"completed_at":"2026-10-26T14:22:43.592Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019141,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.521757] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.593Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"626106c07d9ddc9dff9ec54c","created_at":"2026-10-26T14:22:43.378Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.379Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-626106c07d9ddc9dff9ec54c: start","job_status":"start","queue_duration_s":0.213846,"scheduling_latency_s":0.213859} gitlab # [ 241.565980] gitaly[903]: time="2026-10-26T14:22:43.420Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=70 command.spawn_token_fork_ms=66 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F62AHPJRBKQSBWMMYWHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:53.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:43.348" grpc.time_ms=71.231 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.566715] gitaly[903]: time="2026-10-26T14:22:43.425Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F5GP5C0MM40FAG9CSW76 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:43.425" grpc.time_ms=0.264 pid=903 span.kind=server system=grpc gitlab # [ 241.567514] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23a7074fb93b50049786134fe9da224ba53e02cb HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 170 gitlab # [ 241.567960] gitlab-workhorse[826]: time="2026-10-26T14:22:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 241.568562] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 86 gitlab # [ 241.569120] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.628Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"626106c07d9ddc9dff9ec54c","created_at":"2026-10-26T14:22:43.378Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.379Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-626106c07d9ddc9dff9ec54c: done: 0.034531 sec","job_status":"done","queue_duration_s":0.213846,"scheduling_latency_s":0.213859,"redis_calls":7,"redis_duration_s":0.003105,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002769,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034531,"completed_at":"2026-10-26T14:22:43.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007603,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.611887] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.632Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"6afad7bc39a2e1cc7f80a4d6","created_at":"2026-10-26T14:22:43.454Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.456Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-6afad7bc39a2e1cc7f80a4d6: start","job_status":"start","queue_duration_s":0.176248,"scheduling_latency_s":0.176268} gitlab # [ 241.612653] gitaly[903]: time="2026-10-26T14:22:43.442Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F5GP5C0MM40FAG9CSW76 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:43.441" grpc.time_ms=0.379 pid=903 span.kind=server system=grpc gitlab # [ 241.622087] gitaly[903]: time="2026-10-26T14:22:43.450Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F5GP5C0MM40FAG9CSW76 diskcache=1790532d-7640-4144-8e28-8e8826b7e49b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T14:23:13.383" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:43.383" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.629730] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 46 gitlab # [ 241.631572] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 53 gitlab # [ 241.633643] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.653Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"6afad7bc39a2e1cc7f80a4d6","created_at":"2026-10-26T14:22:43.454Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.456Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-6afad7bc39a2e1cc7f80a4d6: done: 0.020809 sec","job_status":"done","queue_duration_s":0.176248,"scheduling_latency_s":0.176268,"redis_calls":7,"redis_duration_s":0.00272,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001171,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020809,"completed_at":"2026-10-26T14:22:43.653Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.684709] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.654Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dc761aad744169480f70e4d1","created_at":"2026-10-26T14:22:43.460Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.461Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dc761aad744169480f70e4d1: start","job_status":"start","queue_duration_s":0.192573,"scheduling_latency_s":0.192588} gitlab # [ 241.724889] gitaly[903]: time="2026-10-26T14:22:43.450Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7124 command.oublock=0 command.real_time_ms=60 command.spawn_token_fork_ms=3 command.system_time_ms=38 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F5GP5C0MM40FAG9CSW76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T14:23:13.383" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:43.383" grpc.time_ms=66.779 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.725584] gitlab-workhorse[826]: time="2026-10-26T14:22:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 241.727624] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 52 gitlab # [ 241.729114] gitlab-workhorse[826]: time="2026-10-26T14:22:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=221 gitlab # [ 241.729735] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 63 gitlab # [ 241.732232] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.680Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dc761aad744169480f70e4d1","created_at":"2026-10-26T14:22:43.460Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.461Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dc761aad744169480f70e4d1: done: 0.026621 sec","job_status":"done","queue_duration_s":0.192573,"scheduling_latency_s":0.192588,"redis_calls":7,"redis_duration_s":0.006302,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002509,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003793,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026621,"completed_at":"2026-10-26T14:22:43.680Z","load_balancing_strategy":"primary","db_duration_s":0.002663,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.744391] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.682Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0d17731f18f4c23928108885","created_at":"2026-10-26T14:22:43.466Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.467Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0d17731f18f4c23928108885: start","job_status":"start","queue_duration_s":0.215123,"scheduling_latency_s":0.215137} gitlab # [ 241.756871] gitaly[903]: time="2026-10-26T14:22:43.485Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F5GP5C0MM40FAG9CSW76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T14:23:13.484" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:43.484" grpc.time_ms=0.671 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.768667] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 62 gitlab # [ 241.770259] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.719Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0d17731f18f4c23928108885","created_at":"2026-10-26T14:22:43.466Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.467Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0d17731f18f4c23928108885: done: 0.036783 sec","job_status":"done","queue_duration_s":0.215123,"scheduling_latency_s":0.215137,"redis_calls":10,"redis_duration_s":0.004619,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003256,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000485,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036783,"completed_at":"2026-10-26T14:22:43.719Z","load_balancing_strategy":"primary","db_duration_s":0.009856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.812233] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.720Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0ffb620dd3207950951c95dc","created_at":"2026-10-26T14:22:43.467Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.468Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0ffb620dd3207950951c95dc: start","job_status":"start","queue_duration_s":0.252269,"scheduling_latency_s":0.252284} gitlab # [ 241.824525] gitaly[903]: time="2026-10-26T14:22:43.503Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F5GP5C0MM40FAG9CSW76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:13.502" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:43.503" grpc.time_ms=0.428 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.868215] gitaly[903]: time="2026-10-26T14:22:43.633Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F66R1X1ZQGKYHZMGA2Q0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.626" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 241.868890] gitlab-workhorse[826]: time="2026-10-26T14:22:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 241.869350] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 52 gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81' gitlab # [ 241.869810] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.738Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0ffb620dd3207950951c95dc","created_at":"2026-10-26T14:22:43.467Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.468Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0ffb620dd3207950951c95dc: done: 0.018338 sec","job_status":"done","queue_duration_s":0.252269,"scheduling_latency_s":0.252284,"redis_calls":7,"redis_duration_s":0.0025729999999999998,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000869,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018338,"completed_at":"2026-10-26T14:22:43.738Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.885704] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.740Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8b334e41f29b99dbf839243a","created_at":"2026-10-26T14:22:43.468Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.470Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8b334e41f29b99dbf839243a: start","job_status":"start","queue_duration_s":0.269688,"scheduling_latency_s":0.269703} gitlab # [ 241.932499] gitaly[903]: time="2026-10-26T14:22:43.633Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F66R1X1ZQGKYHZMGA2Q0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.626" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81', in 0.05 seconds) (finished: subtest: push delivers the webhook, in 45.76 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses gitlab # [ 241.933102] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.761Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8b334e41f29b99dbf839243a","created_at":"2026-10-26T14:22:43.468Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.470Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8b334e41f29b99dbf839243a: done: 0.020778 sec","job_status":"done","queue_duration_s":0.269688,"scheduling_latency_s":0.269703,"redis_calls":8,"redis_duration_s":0.001265,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020778,"completed_at":"2026-10-26T14:22:43.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003592,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.948230] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.762Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3d4504d5584810484ed63a3d","created_at":"2026-10-26T14:22:43.471Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.473Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3d4504d5584810484ed63a3d: start","job_status":"start","queue_duration_s":0.28915,"scheduling_latency_s":0.289166} gitlab # [ 241.965072] gitaly[903]: time="2026-10-26T14:22:43.633Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F66R1X1ZQGKYHZMGA2Q0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.626" grpc.time_ms=7.183 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.014985] nixbot[2613]: {"ts": "2026-10-26T14:22:44.244Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53666 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e96e9bd0e484012958fa71498bcd8397ab353f81 HTTP/1.1\" 200"} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses, in 0.09 seconds) gitlab # [ 242.016604] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.777Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3d4504d5584810484ed63a3d","created_at":"2026-10-26T14:22:43.471Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.473Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3d4504d5584810484ed63a3d: done: 0.015487 sec","job_status":"done","queue_duration_s":0.28915,"scheduling_latency_s":0.289166,"redis_calls":7,"redis_duration_s":0.001655,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015487,"completed_at":"2026-10-26T14:22:43.777Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.019558] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.779Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"eb81bc3b17d24e439ac3e1e8","created_at":"2026-10-26T14:22:43.473Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.474Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-eb81bc3b17d24e439ac3e1e8: start","job_status":"start","queue_duration_s":0.304924,"scheduling_latency_s":0.304938} gitlab # [ 242.035384] gitaly[903]: time="2026-10-26T14:22:43.672Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6D5H1Z7NG2JDAW8ZD5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:13.571" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:43.672" grpc.time_ms=0.53 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.045593] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.798Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"eb81bc3b17d24e439ac3e1e8","created_at":"2026-10-26T14:22:43.473Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.474Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-eb81bc3b17d24e439ac3e1e8: done: 0.019472 sec","job_status":"done","queue_duration_s":0.304924,"scheduling_latency_s":0.304938,"redis_calls":7,"redis_duration_s":0.001599,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019472,"completed_at":"2026-10-26T14:22:43.798Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.088224] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.801Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d52d2f9f3c28271e51426a4a","created_at":"2026-10-26T14:22:43.474Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.475Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d52d2f9f3c28271e51426a4a: start","job_status":"start","queue_duration_s":0.325809,"scheduling_latency_s":0.325827} gitlab # [ 242.097792] gitaly[903]: time="2026-10-26T14:22:43.717Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F6E9VCQNYY16G90B9EN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.707" grpc.time_ms=9.829 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.136287] nixbot[2613]: {"ts": "2026-10-26T14:22:44.359Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-e96e9bd0e484-6"} gitlab # [ 242.137189] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.811Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d52d2f9f3c28271e51426a4a","created_at":"2026-10-26T14:22:43.474Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.475Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d52d2f9f3c28271e51426a4a: done: 0.009731 sec","job_status":"done","queue_duration_s":0.325809,"scheduling_latency_s":0.325827,"redis_calls":7,"redis_duration_s":0.0008810000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009731,"completed_at":"2026-10-26T14:22:43.811Z","load_balancing_strategy":"primary","db_duration_s":0.000289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.177048] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.812Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ce0492172ba6d4cadb97b851","created_at":"2026-10-26T14:22:43.475Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.476Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ce0492172ba6d4cadb97b851: start","job_status":"start","queue_duration_s":0.33568,"scheduling_latency_s":0.335692} gitlab # [ 242.177714] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 64 gitlab # [ 242.178033] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e96e9bd0e484012958fa71498bcd8397ab353f81 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 242 gitlab # [ 242.178536] gitaly[903]: time="2026-10-26T14:22:43.721Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=16 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F6D5H1Z7NG2JDAW8ZD5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:53.258" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:43.699" grpc.time_ms=21.989 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.179516] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.831Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ce0492172ba6d4cadb97b851","created_at":"2026-10-26T14:22:43.475Z","trace_propagation_headers":{"sentry-trace":"23c5235ec65f42e0b82c81ddd4e3653b-a2d0b0320f154d4d","baggage":"sentry-trace_id=23c5235ec65f42e0b82c81ddd4e3653b,sentry-release=Unknown"},"correlation_id":"01M5W9F5GP5C0MM40FAG9CSW76","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.476Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ce0492172ba6d4cadb97b851: done: 0.018999 sec","job_status":"done","queue_duration_s":0.33568,"scheduling_latency_s":0.335692,"redis_calls":7,"redis_duration_s":0.0031279999999999997,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018999,"completed_at":"2026-10-26T14:22:43.831Z","load_balancing_strategy":"primary","db_duration_s":0.0038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.234750] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:43.832Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9564d6caf8df7df0cb731621","created_at":"2026-10-26T14:22:43.582Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-ca490f7759a24897","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.589Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9564d6caf8df7df0cb731621: start","job_status":"start","queue_duration_s":0.243379,"scheduling_latency_s":0.243392} gitlab # [ 242.235595] nixbot[2613]: {"ts": "2026-10-26T14:22:44.441Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e96e9bd0e484-6", "argv0": "bwrap"} gitlab # [ 242.236127] gitaly[903]: time="2026-10-26T14:22:43.806Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6G8N77HXHDDYHKXSD5N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.798" pid=903 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 242.274819] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.065Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9564d6caf8df7df0cb731621","created_at":"2026-10-26T14:22:43.582Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-ca490f7759a24897","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.589Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2488,"job_status":"rescheduled","message":"PipelineProcessWorker JID-9564d6caf8df7df0cb731621: rescheduled"} gitlab # [ 242.275532] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.070Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9564d6caf8df7df0cb731621","created_at":"2026-10-26T14:22:43.582Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-ca490f7759a24897","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.589Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9564d6caf8df7df0cb731621: done: 0.237694 sec","job_status":"done","queue_duration_s":0.243379,"scheduling_latency_s":0.243392,"gitaly_calls":3,"gitaly_duration_s":0.111368,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.019231,"redis_read_bytes":146,"redis_write_bytes":18012,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000315,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000655,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003849,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.009336,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000216,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000693,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003852,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078995,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.208230376,"duration_s":0.237694,"completed_at":"2026-10-26T14:22:44.070Z","load_balancing_strategy":"primary","db_duration_s":0.029838,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.314251] gitaly[903]: time="2026-10-26T14:22:43.806Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6G8N77HXHDDYHKXSD5N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.798" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.314890] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.071Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2017fcde1b8bd5275e78e212","created_at":"2026-10-26T14:22:43.879Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.880Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2017fcde1b8bd5275e78e212: start","job_status":"start","queue_duration_s":0.191215,"scheduling_latency_s":0.191243} gitlab # [ 242.322149] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.104Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2017fcde1b8bd5275e78e212","created_at":"2026-10-26T14:22:43.879Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.880Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2017fcde1b8bd5275e78e212: done: 0.032693 sec","job_status":"done","queue_duration_s":0.191215,"scheduling_latency_s":0.191243,"redis_calls":7,"redis_duration_s":0.00109,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032693,"completed_at":"2026-10-26T14:22:44.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007589,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.364879] gitaly[903]: time="2026-10-26T14:22:43.806Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6G8N77HXHDDYHKXSD5N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.798" grpc.time_ms=7.654 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.371807] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.105Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"09b3f20646bf07ed28277929","created_at":"2026-10-26T14:22:43.994Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.995Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-09b3f20646bf07ed28277929: start","job_status":"start","queue_duration_s":0.10989,"scheduling_latency_s":0.109909} gitlab # [ 242.419102] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.124Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"09b3f20646bf07ed28277929","created_at":"2026-10-26T14:22:43.994Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:43.995Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-09b3f20646bf07ed28277929: done: 0.018587 sec","job_status":"done","queue_duration_s":0.10989,"scheduling_latency_s":0.109909,"redis_calls":7,"redis_duration_s":0.001169,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018587,"completed_at":"2026-10-26T14:22:44.124Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.458300] gitaly[903]: time="2026-10-26T14:22:43.881Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F6KVHAB4F593G95R3CTM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.873" grpc.time_ms=8.319 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.458975] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.125Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e3391bb06d4cdf6cbc936900","created_at":"2026-10-26T14:22:44.001Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.003Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e3391bb06d4cdf6cbc936900: start","job_status":"start","queue_duration_s":0.122803,"scheduling_latency_s":0.122819} gitlab # [ 242.459576] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.147Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e3391bb06d4cdf6cbc936900","created_at":"2026-10-26T14:22:44.001Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.003Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e3391bb06d4cdf6cbc936900: done: 0.021253 sec","job_status":"done","queue_duration_s":0.122803,"scheduling_latency_s":0.122819,"redis_calls":7,"redis_duration_s":0.001024,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021253,"completed_at":"2026-10-26T14:22:44.147Z","load_balancing_strategy":"primary","db_duration_s":0.004727,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.484647] gitaly[903]: time="2026-10-26T14:22:43.885Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=9 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F6KRQKHR32QNYGBGW3HQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.870" grpc.time_ms=14.557 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.530161] gitaly[903]: time="2026-10-26T14:22:43.911Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F62AHPJRBKQSBWMMYWHG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:43.911" grpc.time_ms=0.282 pid=903 span.kind=server system=grpc gitlab # [ 242.530855] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.148Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"71c7efaaa41a6c21e3aa8a25","created_at":"2026-10-26T14:22:44.008Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.009Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-71c7efaaa41a6c21e3aa8a25: start","job_status":"start","queue_duration_s":0.13869,"scheduling_latency_s":0.138708} gitlab # [ 242.531486] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.168Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"71c7efaaa41a6c21e3aa8a25","created_at":"2026-10-26T14:22:44.008Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.009Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-71c7efaaa41a6c21e3aa8a25: done: 0.019449 sec","job_status":"done","queue_duration_s":0.13869,"scheduling_latency_s":0.138708,"redis_calls":10,"redis_duration_s":0.001399,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00042,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019449,"completed_at":"2026-10-26T14:22:44.168Z","load_balancing_strategy":"primary","db_duration_s":0.00345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.577659] gitaly[903]: time="2026-10-26T14:22:43.938Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6NF1N0G6YP9NYXVCVQ2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.928" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 242.578508] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.169Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"17d3179e8cba7b24fe773fd7","created_at":"2026-10-26T14:22:44.010Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.011Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-17d3179e8cba7b24fe773fd7: start","job_status":"start","queue_duration_s":0.157837,"scheduling_latency_s":0.15785} gitlab # [ 242.579116] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.186Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"17d3179e8cba7b24fe773fd7","created_at":"2026-10-26T14:22:44.010Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.011Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-17d3179e8cba7b24fe773fd7: done: 0.017555 sec","job_status":"done","queue_duration_s":0.157837,"scheduling_latency_s":0.15785,"redis_calls":7,"redis_duration_s":0.001024,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017555,"completed_at":"2026-10-26T14:22:44.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.650300] gitaly[903]: time="2026-10-26T14:22:43.938Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6NF1N0G6YP9NYXVCVQ2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.928" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.650923] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.187Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d8057f6dce1a94060ea14b1e","created_at":"2026-10-26T14:22:44.011Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.013Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d8057f6dce1a94060ea14b1e: start","job_status":"start","queue_duration_s":0.174066,"scheduling_latency_s":0.174079} gitlab # [ 242.651531] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.203Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d8057f6dce1a94060ea14b1e","created_at":"2026-10-26T14:22:44.011Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.013Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d8057f6dce1a94060ea14b1e: done: 0.016104 sec","job_status":"done","queue_duration_s":0.174066,"scheduling_latency_s":0.174079,"redis_calls":8,"redis_duration_s":0.0011840000000000002,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016104,"completed_at":"2026-10-26T14:22:44.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.712221] gitaly[903]: time="2026-10-26T14:22:43.939Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6NF1N0G6YP9NYXVCVQ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.928" grpc.time_ms=9.924 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.712871] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.204Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"36e34d84eb91aac13c57807f","created_at":"2026-10-26T14:22:44.014Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.016Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-36e34d84eb91aac13c57807f: start","job_status":"start","queue_duration_s":0.187739,"scheduling_latency_s":0.187751} gitlab # [ 242.713497] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.221Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"36e34d84eb91aac13c57807f","created_at":"2026-10-26T14:22:44.014Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.016Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-36e34d84eb91aac13c57807f: done: 0.016468 sec","job_status":"done","queue_duration_s":0.187739,"scheduling_latency_s":0.187751,"redis_calls":7,"redis_duration_s":0.001212,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000365,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016468,"completed_at":"2026-10-26T14:22:44.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.751214] gitaly[903]: time="2026-10-26T14:22:43.945Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6NBMW41P6PM83STJQY0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.930" pid=903 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc gitlab # [ 242.751882] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.222Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9a40319c914fe5fd74f75a13","created_at":"2026-10-26T14:22:44.017Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.019Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9a40319c914fe5fd74f75a13: start","job_status":"start","queue_duration_s":0.203352,"scheduling_latency_s":0.203371} gitlab # [ 242.765538] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.247Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9a40319c914fe5fd74f75a13","created_at":"2026-10-26T14:22:44.017Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.019Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9a40319c914fe5fd74f75a13: done: 0.024952 sec","job_status":"done","queue_duration_s":0.203352,"scheduling_latency_s":0.203371,"redis_calls":7,"redis_duration_s":0.0027340000000000003,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002439,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024952,"completed_at":"2026-10-26T14:22:44.247Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.813492] gitaly[903]: time="2026-10-26T14:22:43.945Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6NBMW41P6PM83STJQY0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.930" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.815457] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.248Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0f3888fcaac6e51bf1083d15","created_at":"2026-10-26T14:22:44.020Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.021Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0f3888fcaac6e51bf1083d15: start","job_status":"start","queue_duration_s":0.226743,"scheduling_latency_s":0.226757} gitlab # [ 242.854653] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.259Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0f3888fcaac6e51bf1083d15","created_at":"2026-10-26T14:22:44.020Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.021Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0f3888fcaac6e51bf1083d15: done: 0.011299 sec","job_status":"done","queue_duration_s":0.226743,"scheduling_latency_s":0.226757,"redis_calls":7,"redis_duration_s":0.002052,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001785,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011299,"completed_at":"2026-10-26T14:22:44.259Z","load_balancing_strategy":"primary","db_duration_s":0.001429,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.893896] gitaly[903]: time="2026-10-26T14:22:43.945Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6NBMW41P6PM83STJQY0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:43.930" grpc.time_ms=15.311 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.894602] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.260Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3d46d22bdfada90aad4db24b","created_at":"2026-10-26T14:22:44.022Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.024Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3d46d22bdfada90aad4db24b: start","job_status":"start","queue_duration_s":0.235954,"scheduling_latency_s":0.235967} gitlab # [ 242.895480] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.289Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3d46d22bdfada90aad4db24b","created_at":"2026-10-26T14:22:44.022Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.024Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3d46d22bdfada90aad4db24b: done: 0.028641 sec","job_status":"done","queue_duration_s":0.235954,"scheduling_latency_s":0.235967,"redis_calls":7,"redis_duration_s":0.001125,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000354,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028641,"completed_at":"2026-10-26T14:22:44.289Z","load_balancing_strategy":"primary","db_duration_s":0.008692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.951833] gitaly[903]: time="2026-10-26T14:22:43.955Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F62AHPJRBKQSBWMMYWHG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:43.955" grpc.time_ms=0.484 pid=903 span.kind=server system=grpc gitlab # [ 242.952621] gitaly[903]: time="2026-10-26T14:22:43.978Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F62AHPJRBKQSBWMMYWHG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:43.978" grpc.time_ms=0.298 pid=903 span.kind=server system=grpc gitlab # [ 242.953428] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.290Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"551e13d69f82fc1af1134183","created_at":"2026-10-26T14:22:44.065Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.066Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-551e13d69f82fc1af1134183: start","job_status":"start","queue_duration_s":0.223883,"scheduling_latency_s":0.223899} gitlab # [ 242.960663] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.312Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"551e13d69f82fc1af1134183","created_at":"2026-10-26T14:22:44.065Z","trace_propagation_headers":{"sentry-trace":"03f1bfbeabce43dc9b646b953801b5fc-98af0e654e9246ee","baggage":"sentry-trace_id=03f1bfbeabce43dc9b646b953801b5fc,sentry-release=Unknown"},"correlation_id":"01M5W9F62AHPJRBKQSBWMMYWHG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.066Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-551e13d69f82fc1af1134183: done: 0.022189 sec","job_status":"done","queue_duration_s":0.223883,"scheduling_latency_s":0.223899,"redis_calls":8,"redis_duration_s":0.006579,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005752,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000827,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022189,"completed_at":"2026-10-26T14:22:44.312Z","load_balancing_strategy":"primary","db_duration_s":0.002237,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.999946] gitaly[903]: time="2026-10-26T14:22:43.988Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F62AHPJRBKQSBWMMYWHG diskcache=281d35bf-04b8-4ed1-9fec-9925ed31d0b3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T14:23:13.884" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:43.884" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses gitlab # [ 243.005870] gitaly[903]: time="2026-10-26T14:22:43.988Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=62 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7038 command.oublock=0 command.real_time_ms=96 command.spawn_token_fork_ms=1 command.system_time_ms=38 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F62AHPJRBKQSBWMMYWHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T14:23:13.884" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:43.884" grpc.time_ms=103.944 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.017866] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.315Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c45f3faff3567b97bde0a567","created_at":"2026-10-26T14:22:44.282Z","trace_propagation_headers":{"sentry-trace":"0967b77da28944bcb714848276520a03-808897b5985443fb","baggage":"sentry-trace_id=0967b77da28944bcb714848276520a03,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F6WBX8F1J615EZK6Z5WF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.287Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c45f3faff3567b97bde0a567: start","job_status":"start","queue_duration_s":0.028418,"scheduling_latency_s":0.028431} gitlab # [ 243.056702] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.333Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c45f3faff3567b97bde0a567","created_at":"2026-10-26T14:22:44.282Z","trace_propagation_headers":{"sentry-trace":"0967b77da28944bcb714848276520a03-808897b5985443fb","baggage":"sentry-trace_id=0967b77da28944bcb714848276520a03,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F6WBX8F1J615EZK6Z5WF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.287Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c45f3faff3567b97bde0a567: done: 0.018066 sec","job_status":"done","queue_duration_s":0.028418,"scheduling_latency_s":0.028431,"redis_calls":7,"redis_duration_s":0.000946,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018066,"completed_at":"2026-10-26T14:22:44.333Z","load_balancing_strategy":"primary","db_duration_s":0.002749,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.104710] gitaly[903]: time="2026-10-26T14:22:44.027Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=7 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F6QW3X5V2RBQPQN19GGM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:44.015" grpc.time_ms=11.638 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 243.105562] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.334Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"720ff75d63b2327015497921","created_at":"2026-10-26T14:22:44.287Z","trace_propagation_headers":{"sentry-trace":"0967b77da28944bcb714848276520a03-808897b5985443fb","baggage":"sentry-trace_id=0967b77da28944bcb714848276520a03,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F6WBX8F1J615EZK6Z5WF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.290Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-720ff75d63b2327015497921: start","job_status":"start","queue_duration_s":0.044582,"scheduling_latency_s":0.044594} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses, in 0.09 seconds) gitlab # [ 243.106291] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.367Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"720ff75d63b2327015497921","created_at":"2026-10-26T14:22:44.287Z","trace_propagation_headers":{"sentry-trace":"0967b77da28944bcb714848276520a03-808897b5985443fb","baggage":"sentry-trace_id=0967b77da28944bcb714848276520a03,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F6WBX8F1J615EZK6Z5WF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.290Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-720ff75d63b2327015497921: done: 0.032986 sec","job_status":"done","queue_duration_s":0.044582,"scheduling_latency_s":0.044594,"redis_calls":10,"redis_duration_s":0.001536,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000694,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032986,"completed_at":"2026-10-26T14:22:44.367Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007805,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.159349] gitaly[903]: time="2026-10-26T14:22:44.036Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F62AHPJRBKQSBWMMYWHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T14:23:14.035" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:44.035" grpc.time_ms=0.71 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.160291] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 43 gitlab # [ 243.161118] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.369Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2dc80f2ddabf8641406fff4a","created_at":"2026-10-26T14:22:44.330Z","trace_propagation_headers":{"sentry-trace":"0967b77da28944bcb714848276520a03-808897b5985443fb","baggage":"sentry-trace_id=0967b77da28944bcb714848276520a03,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F6WBX8F1J615EZK6Z5WF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.335Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2dc80f2ddabf8641406fff4a: start","job_status":"start","queue_duration_s":0.033949,"scheduling_latency_s":0.033968} gitlab # [ 243.163900] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.461Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2dc80f2ddabf8641406fff4a","created_at":"2026-10-26T14:22:44.330Z","trace_propagation_headers":{"sentry-trace":"0967b77da28944bcb714848276520a03-808897b5985443fb","baggage":"sentry-trace_id=0967b77da28944bcb714848276520a03,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9F6WBX8F1J615EZK6Z5WF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.335Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2dc80f2ddabf8641406fff4a: done: 0.092042 sec","job_status":"done","queue_duration_s":0.033949,"scheduling_latency_s":0.033968,"gitaly_calls":2,"gitaly_duration_s":0.004634,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004317,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000667,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000765,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00018,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000154,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000319,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063746,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.069340656,"duration_s":0.092042,"completed_at":"2026-10-26T14:22:44.461Z","load_balancing_strategy":"primary","db_duration_s":0.023234,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.242236] gitaly[903]: time="2026-10-26T14:22:44.057Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F62AHPJRBKQSBWMMYWHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:14.056" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:44.056" grpc.time_ms=0.648 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.242966] gitaly[903]: time="2026-10-26T14:22:44.081Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6SXFEJMZAJVRA8VYHGG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:44.070" pid=903 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 243.243577] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.462Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"1b3134ff72b0873110ec9c24","created_at":"2026-10-26T14:22:44.413Z","trace_propagation_headers":{"sentry-trace":"0967b77da28944bcb714848276520a03-18fadd38cfcf4f9c","baggage":"sentry-trace_id=0967b77da28944bcb714848276520a03,sentry-release=Unknown"},"correlation_id":"01M5W9F6WBX8F1J615EZK6Z5WF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.414Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1b3134ff72b0873110ec9c24: start","job_status":"start","queue_duration_s":0.047571,"scheduling_latency_s":0.047585} gitlab # [ 243.244562] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:44.487Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"1b3134ff72b0873110ec9c24","created_at":"2026-10-26T14:22:44.413Z","trace_propagation_headers":{"sentry-trace":"0967b77da28944bcb714848276520a03-18fadd38cfcf4f9c","baggage":"sentry-trace_id=0967b77da28944bcb714848276520a03,sentry-release=Unknown"},"correlation_id":"01M5W9F6WBX8F1J615EZK6Z5WF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:44.414Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1b3134ff72b0873110ec9c24: done: 0.025581 sec","job_status":"done","queue_duration_s":0.047571,"scheduling_latency_s":0.047585,"redis_calls":7,"redis_duration_s":0.001016,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025581,"completed_at":"2026-10-26T14:22:44.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.309825] gitaly[903]: time="2026-10-26T14:22:44.081Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1160 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6SXFEJMZAJVRA8VYHGG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:44.070" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 243.310576] gitaly[903]: time="2026-10-26T14:22:44.081Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1160 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6SXFEJMZAJVRA8VYHGG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:44.070" grpc.time_ms=10.975 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 243.311226] gitaly[903]: time="2026-10-26T14:22:44.146Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:14.045" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:44.145" grpc.time_ms=0.402 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.318635] gitaly[903]: time="2026-10-26T14:22:44.158Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-26T14:23:14.052" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:44.152" grpc.time_ms=5.93 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.331492] gitaly[903]: time="2026-10-26T14:22:44.167Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:22:54.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:44.162" grpc.time_ms=4.76 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.370063] gitaly[903]: time="2026-10-26T14:22:44.189Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-26T14:22:54.029" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:44.189" grpc.time_ms=0.194 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.370771] gitaly[903]: time="2026-10-26T14:22:44.198Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-26T14:22:54.032" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:44.193" grpc.time_ms=5.077 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.371419] gitaly[903]: time="2026-10-26T14:22:44.236Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:44.236" grpc.time_ms=0.493 pid=903 span.kind=server system=grpc gitlab # [ 243.373212] gitaly[903]: time="2026-10-26T14:22:44.260Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:44.260" grpc.time_ms=0.334 pid=903 span.kind=server system=grpc gitlab # [ 243.411867] gitaly[903]: time="2026-10-26T14:22:44.268Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T14:22:54.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:44.200" operations="[repack_refs]" pid=903 ref=refs/keep-around/e96e9bd0e484012958fa71498bcd8397ab353f81 remote_ip="2001:db8:1::1" revision=e96e9bd0e484012958fa71498bcd8397ab353f81 span.kind=server system=grpc username=root gitlab # [ 243.412614] gitaly[903]: time="2026-10-26T14:22:44.270Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T14:22:54.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:44.200" pid=903 ref=refs/keep-around/e96e9bd0e484012958fa71498bcd8397ab353f81 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-26 14:21:47.95932372 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" revision=e96e9bd0e484012958fa71498bcd8397ab353f81 span.kind=server system=grpc username=root gitlab # [ 243.413432] gitaly[903]: time="2026-10-26T14:22:44.275Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF diskcache=7b246af6-65c7-4030-a8d7-1e8650daffff grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T14:22:54.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:44.200" pid=903 ref=refs/keep-around/e96e9bd0e484012958fa71498bcd8397ab353f81 remote_ip="2001:db8:1::1" revision=e96e9bd0e484012958fa71498bcd8397ab353f81 span.kind=server system=grpc username=root gitlab # [ 243.414390] gitaly[903]: time="2026-10-26T14:22:44.275Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=42 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5454 command.oublock=8 command.real_time_ms=70 command.spawn_token_fork_ms=1 command.system_time_ms=32 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T14:22:54.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:44.200" grpc.time_ms=75.431 pid=903 ref=refs/keep-around/e96e9bd0e484012958fa71498bcd8397ab353f81 remote_ip="2001:db8:1::1" revision=e96e9bd0e484012958fa71498bcd8397ab353f81 span.kind=server system=grpc username=root gitlab # [ 243.456030] gitaly[903]: time="2026-10-26T14:22:44.280Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:14.179" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:44.279" grpc.time_ms=0.591 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.456714] gitaly[903]: time="2026-10-26T14:22:44.284Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T14:22:54.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:44.200" pid=903 ref=refs/keep-around/e96e9bd0e484012958fa71498bcd8397ab353f81 remote_ip="2001:db8:1::1" revision=e96e9bd0e484012958fa71498bcd8397ab353f81 span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 243.457559] gitaly[903]: time="2026-10-26T14:22:44.284Z" level=info msg="optimized repository" clean_stale_data_time=13.938364ms clean_work_trees_time="75.149µs" commit_graph_time="3.911µs" correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.912µs" pid=903 prune_time="3.074µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.911µs" storage_name=default system=housekeeping total_time=14.121348ms gitlab # [ 243.458723] gitaly[903]: time="2026-10-26T14:22:44.285Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-26T14:22:54.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-26T14:22:44.200" pid=903 ref=refs/keep-around/e96e9bd0e484012958fa71498bcd8397ab353f81 remote_ip="2001:db8:1::1" revision=e96e9bd0e484012958fa71498bcd8397ab353f81 span.kind=server system=grpc username=root gitlab # [ 243.500860] gitaly[903]: time="2026-10-26T14:22:44.313Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F71H24QX4NKAH772ZECH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:14.212" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:44.313" grpc.time_ms=0.72 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.501563] gitaly[903]: time="2026-10-26T14:22:44.425Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T14:23:14.424" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:44.424" grpc.time_ms=0.684 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.502280] gitaly[903]: time="2026-10-26T14:22:44.453Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F6WBX8F1J615EZK6Z5WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:14.452" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:44.452" grpc.time_ms=0.522 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.502875] gitaly[903]: time="2026-10-26T14:22:45.412Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F847PY2XPFPHJBVG55TX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:15.312" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:45.412" grpc.time_ms=0.449 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.606572] nix-daemon[2782]: accepted connection from pid 3655, user nixbot gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses gitlab # [ 244.246386] gitaly[903]: time="2026-10-26T14:22:46.536Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9F96AQAP5H0JB9GHYKV5Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:16.234" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:46.535" grpc.time_ms=0.918 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.313773] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 127 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses, in 0.18 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses gitlab # [ 245.418520] gitaly[903]: time="2026-10-26T14:22:47.707Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FAB0K22DYD7KC8Z15A0Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:17.606" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:47.706" grpc.time_ms=0.843 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.446960] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 84 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses, in 0.13 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses gitlab # [ 246.583940] gitaly[903]: time="2026-10-26T14:22:48.873Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FBEAG9Z9B7XY9WHAC81Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:18.571" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:48.872" grpc.time_ms=1.007 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.645312] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 155 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses, in 0.20 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses gitlab # [ 247.749433] gitaly[903]: time="2026-10-26T14:22:50.038Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FCKVT7XCC07KHRJ9GKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:20.037" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:50.037" grpc.time_ms=0.897 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.781259] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 90 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses, in 0.13 seconds) gitlab # [ 248.066907] nix-daemon[2782]: accepted connection from pid 3690, user nixbot gitlab # [ 248.079333] nix-daemon[2782]: accepted connection from pid 3655, user nixbot gitlab # [ 248.153431] gitaly[903]: time="2026-10-26T14:22:50.443Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FD16SPQZSDA45C0SRC6W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:20.341" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:50.442" grpc.time_ms=0.869 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.213562] gitaly[903]: time="2026-10-26T14:22:50.503Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9FD16SPQZSDA45C0SRC6W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:23:00.050" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:50.491" grpc.time_ms=12.412 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.253292] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.542Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3790fa6a2b0a6cfe0e50d28a","created_at":"2026-10-26T14:22:50.537Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-2e83b8f973c44a44","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.540Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3790fa6a2b0a6cfe0e50d28a: start","job_status":"start","queue_duration_s":0.001811,"scheduling_latency_s":0.001858} gitlab # [ 248.283806] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e96e9bd0e484012958fa71498bcd8397ab353f81 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 159 gitlab # [ 248.325911] gitaly[903]: time="2026-10-26T14:22:50.615Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FD6C5AT5DB6NG9NNZXKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:20.514" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:50.614" grpc.time_ms=1.042 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.357071] gitaly[903]: time="2026-10-26T14:22:50.647Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9FD6C5AT5DB6NG9NNZXKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:23:00.194" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:50.635" grpc.time_ms=11.748 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.389916] gitaly[903]: time="2026-10-26T14:22:50.680Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9FD16SPQZSDA45C0SRC6W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:50.679" grpc.time_ms=0.325 pid=903 span.kind=server system=grpc gitlab # [ 248.407089] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e96e9bd0e484012958fa71498bcd8397ab353f81 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 124 gitlab # [ 248.416720] gitaly[903]: time="2026-10-26T14:22:50.706Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9FD16SPQZSDA45C0SRC6W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:50.706" grpc.time_ms=0.279 pid=903 span.kind=server system=grpc gitlab # [ 248.444396] gitaly[903]: time="2026-10-26T14:22:50.734Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5W9FD16SPQZSDA45C0SRC6W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-26T14:22:50.734" grpc.time_ms=0.477 pid=903 span.kind=server system=grpc gitlab # [ 248.457322] gitaly[903]: time="2026-10-26T14:22:50.747Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FDAV263S60MATD849C2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:20.646" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:50.747" grpc.time_ms=0.447 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.461862] gitaly[903]: time="2026-10-26T14:22:50.752Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FD16SPQZSDA45C0SRC6W diskcache=6019ecdf-2045-4063-8946-9e9e0d59c613 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T14:23:20.655" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:50.655" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.462821] gitaly[903]: time="2026-10-26T14:22:50.752Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=64 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7279 command.oublock=0 command.real_time_ms=90 command.spawn_token_fork_ms=0 command.system_time_ms=45 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FD16SPQZSDA45C0SRC6W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-26T14:23:20.655" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:50.655" grpc.time_ms=96.489 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.485518] gitaly[903]: time="2026-10-26T14:22:50.775Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5W9FDAV263S60MATD849C2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-26T14:23:00.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-26T14:22:50.770" grpc.time_ms=5.433 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.506318] gitaly[903]: time="2026-10-26T14:22:50.796Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9FD16SPQZSDA45C0SRC6W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-26T14:23:20.795" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:50.795" grpc.time_ms=0.611 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.519945] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e96e9bd0e484012958fa71498bcd8397ab353f81 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 94 gitlab # [ 248.530579] gitaly[903]: time="2026-10-26T14:22:50.820Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FD16SPQZSDA45C0SRC6W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-26T14:23:20.819" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-26T14:22:50.820" grpc.time_ms=0.563 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.537466] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.827Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2e440e301959b6d88c859083","created_at":"2026-10-26T14:22:50.826Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"3790fa6a2b0a6cfe0e50d28a","job_size_bytes":3,"pid":2488,"job_status":"deduplicated","message":"PipelineProcessWorker JID-2e440e301959b6d88c859083: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 248.538564] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.828Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3790fa6a2b0a6cfe0e50d28a","created_at":"2026-10-26T14:22:50.537Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-2e83b8f973c44a44","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.540Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2488,"job_status":"rescheduled","message":"PipelineProcessWorker JID-3790fa6a2b0a6cfe0e50d28a: rescheduled"} gitlab # [ 248.544028] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.834Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3790fa6a2b0a6cfe0e50d28a","created_at":"2026-10-26T14:22:50.537Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-2e83b8f973c44a44","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.540Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3790fa6a2b0a6cfe0e50d28a: done: 0.292078 sec","job_status":"done","queue_duration_s":0.001811,"scheduling_latency_s":0.001858,"gitaly_calls":3,"gitaly_duration_s":0.104951,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012628,"redis_read_bytes":239,"redis_write_bytes":21777,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001074,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000904,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003352,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14462,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.004133,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000287,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000336,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001468,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.015,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115399,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.25513969,"duration_s":0.292078,"completed_at":"2026-10-26T14:22:50.833Z","load_balancing_strategy":"primary","db_duration_s":0.061762,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.591059] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.835Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bc7aa4e0ee123cd458660999","created_at":"2026-10-26T14:22:50.647Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.650Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bc7aa4e0ee123cd458660999: start","job_status":"start","queue_duration_s":0.184941,"scheduling_latency_s":0.184959} gitlab # [ 248.591630] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.859Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bc7aa4e0ee123cd458660999","created_at":"2026-10-26T14:22:50.647Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.650Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bc7aa4e0ee123cd458660999: done: 0.024847 sec","job_status":"done","queue_duration_s":0.184941,"scheduling_latency_s":0.184959,"redis_calls":7,"redis_duration_s":0.00091,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024847,"completed_at":"2026-10-26T14:22:50.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004338,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.634266] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.860Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"afca151093e12b233a0d379f","created_at":"2026-10-26T14:22:50.759Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.761Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-afca151093e12b233a0d379f: start","job_status":"start","queue_duration_s":0.099053,"scheduling_latency_s":0.099068} gitlab # [ 248.678674] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.875Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"afca151093e12b233a0d379f","created_at":"2026-10-26T14:22:50.759Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.761Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-afca151093e12b233a0d379f: done: 0.015205 sec","job_status":"done","queue_duration_s":0.099053,"scheduling_latency_s":0.099068,"redis_calls":7,"redis_duration_s":0.0009159999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015205,"completed_at":"2026-10-26T14:22:50.875Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002278,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.680132] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.876Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"18a21eb52f4ae3a8ac78d775","created_at":"2026-10-26T14:22:50.765Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.768Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-18a21eb52f4ae3a8ac78d775: start","job_status":"start","queue_duration_s":0.108782,"scheduling_latency_s":0.108796} gitlab # [ 248.731319] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"18a21eb52f4ae3a8ac78d775","created_at":"2026-10-26T14:22:50.765Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.768Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-18a21eb52f4ae3a8ac78d775: done: 0.015856 sec","job_status":"done","queue_duration_s":0.108782,"scheduling_latency_s":0.108796,"redis_calls":7,"redis_duration_s":0.000944,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015856,"completed_at":"2026-10-26T14:22:50.892Z","load_balancing_strategy":"primary","db_duration_s":0.00275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.732328] nixbot[2613]: {"ts": "2026-10-26T14:22:50.961Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 2, "sha": "e96e9bd0e484012958fa71498bcd8397ab353f81", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []} gitlab # [ 248.772371] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.893Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e2f0612c34381887e60e7eab","created_at":"2026-10-26T14:22:50.772Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.774Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e2f0612c34381887e60e7eab: start","job_status":"start","queue_duration_s":0.119025,"scheduling_latency_s":0.119039} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses gitlab # [ 248.773086] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.910Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e2f0612c34381887e60e7eab","created_at":"2026-10-26T14:22:50.772Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.774Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e2f0612c34381887e60e7eab: done: 0.016898 sec","job_status":"done","queue_duration_s":0.119025,"scheduling_latency_s":0.119039,"redis_calls":10,"redis_duration_s":0.001209,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00033,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016898,"completed_at":"2026-10-26T14:22:50.910Z","load_balancing_strategy":"primary","db_duration_s":0.002524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.814946] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 42 gitlab # [ 248.815678] gitlab-workhorse[826]: time="2026-10-26T14:22:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 248.817083] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/26:14:22:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 45 gitlab # [ 248.817855] gitaly[903]: time="2026-10-26T14:22:51.036Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5W9FDKJMKJ62R4PWWN7V85F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:51.030" grpc.time_ms=5.828 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 248.818558] gitaly[903]: time="2026-10-26T14:22:51.082Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FDMX08DW2BV6VW2H99PZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:51.076" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 248.819299] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.911Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"458e0f52c90938e78a8115f6","created_at":"2026-10-26T14:22:50.775Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.776Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-458e0f52c90938e78a8115f6: start","job_status":"start","queue_duration_s":0.134814,"scheduling_latency_s":0.134826} gitlab # [ 248.858597] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.927Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"458e0f52c90938e78a8115f6","created_at":"2026-10-26T14:22:50.775Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.776Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-458e0f52c90938e78a8115f6: done: 0.01661 sec","job_status":"done","queue_duration_s":0.134814,"scheduling_latency_s":0.134826,"redis_calls":7,"redis_duration_s":0.001437,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01661,"completed_at":"2026-10-26T14:22:50.927Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.867371] gitaly[903]: time="2026-10-26T14:22:51.082Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5W9FDMX08DW2BV6VW2H99PZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-26T14:22:51.076" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e96e9bd0e484012958fa71498bcd8397ab353f81/statuses, in 0.13 seconds) (finished: subtest: eval and build post commit statuses, in 6.96 seconds) (finished: run the VM test script, in 297.64 seconds) gitlab # [ 248.878711] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.929Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d6943db8b3192b0b50c982b5","created_at":"2026-10-26T14:22:50.777Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-26T14:22:50.779Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d6943db8b3192b0b50c982b5: start","job_status":"start","queue_duration_s":0.149966,"scheduling_latency_s":0.149978} test script finished in 297.67s cleanup kill QemuMachine (pid 46) gitlab # [ 248.921827] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-26T14:22:50.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d6943db8b3192b0b50c982b5","created_at":"2026-10-26T14:22:50.777Z","trace_propagation_headers":{"sentry-trace":"91eb2dd716c04469a9c25ad58cd134bb-8f708bddecf94f33","baggage":"sentry-trace_id=91eb2dd716c04469a9c25ad58cd134bb,sentry-release=Unknown"},"correlation_id":"01M5W9FD16SPQZSDA45C0SRC6W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1cqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) gitlab # 3 (finished: cleanup, in 1.38 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-26T14:21:58.150Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'e96e9bd0e484012958fa71498bcd8397ab353f81', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-26T14:22:44.102513Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}] [] [{'id': 5, 'sha': 'e96e9bd0e484012958fa71498bcd8397ab353f81', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T14:22:44.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e96e9bd0e484012958fa71498bcd8397ab353f81', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T14:22:44.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e96e9bd0e484012958fa71498bcd8397ab353f81', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T14:22:44.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e96e9bd0e484012958fa71498bcd8397ab353f81', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T14:22:44.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e96e9bd0e484012958fa71498bcd8397ab353f81', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-26T14:22:44.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e96e9bd0e484012958fa71498bcd8397ab353f81', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-10-26T14:22:44.323Z', 'started_at': None, 'finished_at': '2026-10-26T14:22:50.529Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'e96e9bd0e484012958fa71498bcd8397ab353f81', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-26T14:22:50.676Z', 'started_at': None, 'finished_at': '2026-10-26T14:22:50.792Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]