tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.4vaho14COz', fmt=raw size=1073741824 (finished: start all VMs, in 73.43 seconds) gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab: waiting for unit setup-gitlab.service gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for the VM to finish booting gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: daec9de0-3e92-40d8-b97a-fb69154c62ba gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xal4vpl68x4dbl25bxq3admdybqpgc2a-nixos-system-gitlab-test/init regInfo=/nix/store/xljq8dqvh0ra41ggczgx8xg2qjj65ypz-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 451760332 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor gitlab # [ 0.000812] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000879] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002743] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002754] Using GB pages for direct mapping gitlab # [ 0.002863] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002870] ACPI: Early table checksum verification disabled gitlab # [ 0.002873] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002877] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002881] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002887] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002889] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002890] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002892] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002893] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002895] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002896] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002896] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002897] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002897] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002898] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003116] No NUMA configuration found gitlab # [ 0.003117] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003120] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff] gitlab # [ 0.005433] Zone ranges: gitlab # [ 0.005434] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005436] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005437] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005438] Device empty gitlab # [ 0.005439] Movable zone start for each node gitlab # [ 0.005440] Early memory node ranges gitlab # [ 0.005440] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005441] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005442] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005443] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005463] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.005731] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.112095] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.112535] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.112552] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.112589] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.112592] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.112594] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.112595] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.112596] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.112597] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.112599] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.112601] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.112606] TSC deadline timer available gitlab # [ 0.112611] CPU topo: Max. logical packages: 1 gitlab # [ 0.112612] CPU topo: Max. logical dies: 1 gitlab # [ 0.112612] CPU topo: Max. dies per package: 1 gitlab # [ 0.112616] CPU topo: Max. threads per core: 1 gitlab # [ 0.112617] CPU topo: Num. cores per package: 4 gitlab # [ 0.112617] CPU topo: Num. threads per package: 4 gitlab # [ 0.112617] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.112644] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.112662] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.112665] kvm-guest: setup PV sched yield gitlab # [ 0.112682] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.112684] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.112685] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.112686] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.112688] Booting paravirtualized kernel on KVM gitlab # [ 0.112692] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.117151] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.119283] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.119336] kvm-guest: PV spinlocks enabled gitlab # [ 0.119337] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.119340] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xal4vpl68x4dbl25bxq3admdybqpgc2a-nixos-system-gitlab-test/init regInfo=/nix/store/xljq8dqvh0ra41ggczgx8xg2qjj65ypz-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.119440] Unknown kernel command line parameters "regInfo=/nix/store/xljq8dqvh0ra41ggczgx8xg2qjj65ypz-closure-info/registration", will be passed to user space. gitlab # [ 0.119453] random: crng init done gitlab # [ 0.119454] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.127864] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.132208] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.132282] software IO TLB: area num 4. gitlab # [ 0.203664] Fallback order for Node 0: 0 gitlab # [ 0.203673] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.203675] Policy zone: Normal gitlab # [ 0.206119] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.216264] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.229344] allocated 12582912 bytes of page_ext gitlab # [ 0.239563] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.239565] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.240413] Dynamic Preempt: lazy gitlab # [ 0.240592] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.240592] rcu: RCU event tracing is enabled. gitlab # [ 0.240593] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.240595] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.240595] Rude variant of Tasks RCU enabled. gitlab # [ 0.240596] Tracing variant of Tasks RCU enabled. gitlab # [ 0.240596] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.240597] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.240626] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.240627] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.240629] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.244980] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.245298] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.245308] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.245417] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.249022] Console: colour VGA+ 80x25 gitlab # [ 0.249025] printk: legacy console [tty0] enabled gitlab # [ 0.279436] printk: legacy console [ttyS0] enabled gitlab # [ 0.387831] ACPI: Core revision 20250807 gitlab # [ 0.388745] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.390345] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.391384] x2apic enabled gitlab # [ 0.392123] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.393077] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.394317] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.395859] kvm-guest: setup PV IPIs gitlab # [ 0.397523] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.398607] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns gitlab # [ 0.400397] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) gitlab # [ 0.401481] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.402505] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.404393] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.405397] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.407393] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.408393] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.409392] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.410392] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.411392] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.412401] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.414009] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.416393] active return thunk: srso_alias_return_thunk gitlab # [ 0.417417] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.418393] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.419393] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.420393] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.422393] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.423393] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.424393] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.425393] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.427233] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.428202] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.429189] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.430209] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.431392] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.463098] Freeing SMP alternatives memory: 44K gitlab # [ 0.463396] pid_max: default: 32768 minimum: 301 gitlab # [ 0.464501] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.465499] landlock: Up and running. gitlab # [ 0.466394] Yama: becoming mindful. gitlab # [ 0.467609] LSM support for eBPF active gitlab # [ 0.468597] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.469553] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.472717] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.474048] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.474402] ... version: 2 gitlab # [ 0.475234] ... bit width: 48 gitlab # [ 0.475988] ... generic counters: 6 gitlab # [ 0.476395] ... generic bitmap: 000000000000003f gitlab # [ 0.477371] ... fixed-purpose counters: 0 gitlab # [ 0.477956] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.478395] ... value mask: 0000ffffffffffff gitlab # [ 0.479361] ... max period: 00007fffffffffff gitlab # [ 0.480192] ... global_ctrl mask: 000000000000003f gitlab # [ 0.481262] signal: max sigframe size: 3376 gitlab # [ 0.482008] rcu: Hierarchical SRCU implementation. gitlab # [ 0.482399] rcu: Max phase no-delay instances is 400. gitlab # [ 0.483475] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.489208] smp: Bringing up secondary CPUs ... gitlab # [ 0.490431] smpboot: x86: Booting SMP configuration: gitlab # [ 0.491321] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.493480] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.495397] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) gitlab # [ 0.496786] Memory: 6011532K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved) gitlab # [ 0.498456] devtmpfs: initialized gitlab # [ 0.499398] x86/mm: Memory block size: 128MB gitlab # [ 0.502485] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.503473] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.504524] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.505705] PM: RTC time: 07:38:41, date: 2026-09-04 gitlab # [ 0.509505] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.511792] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.512465] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.514524] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.515409] audit: initializing netlink subsys (disabled) gitlab # [ 0.516518] audit: type=2000 audit(1788507522.592:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.516722] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.518396] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.519395] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.520395] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.521396] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.522411] cpuidle: using governor menu gitlab # [ 0.524603] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.525659] PCI: Using configuration type 1 for base access gitlab # [ 0.526398] PCI: Using configuration type 1 for extended access gitlab # [ 0.527567] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.529689] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.531322] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.532290] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.533336] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.538636] ACPI: Added _OSI(Module Device) gitlab # [ 0.540407] ACPI: Added _OSI(Processor Device) gitlab # [ 0.541401] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.549547] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.556447] ACPI: Interpreter enabled gitlab # [ 0.558585] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.560403] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.562664] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.566402] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.568848] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.582551] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.584410] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.588316] acpiphp: Slot [3] registered gitlab # [ 0.589455] acpiphp: Slot [4] registered gitlab # [ 0.590441] acpiphp: Slot [5] registered gitlab # [ 0.592443] acpiphp: Slot [6] registered gitlab # [ 0.593437] acpiphp: Slot [7] registered gitlab # [ 0.595468] acpiphp: Slot [8] registered gitlab # [ 0.596458] acpiphp: Slot [9] registered gitlab # [ 0.597440] acpiphp: Slot [10] registered gitlab # [ 0.599438] acpiphp: Slot [11] registered gitlab # [ 0.600459] acpiphp: Slot [12] registered gitlab # [ 0.602444] acpiphp: Slot [13] registered gitlab # [ 0.603438] acpiphp: Slot [14] registered gitlab # [ 0.605441] acpiphp: Slot [15] registered gitlab # [ 0.606427] acpiphp: Slot [16] registered gitlab # [ 0.607185] acpiphp: Slot [17] registered gitlab # [ 0.607435] acpiphp: Slot [18] registered gitlab # [ 0.608158] acpiphp: Slot [19] registered gitlab # [ 0.609415] acpiphp: Slot [20] registered gitlab # [ 0.610166] acpiphp: Slot [21] registered gitlab # [ 0.610439] acpiphp: Slot [22] registered gitlab # [ 0.611213] acpiphp: Slot [23] registered gitlab # [ 0.611951] acpiphp: Slot [24] registered gitlab # [ 0.612417] acpiphp: Slot [25] registered gitlab # [ 0.613174] acpiphp: Slot [26] registered gitlab # [ 0.614433] acpiphp: Slot [27] registered gitlab # [ 0.615187] acpiphp: Slot [28] registered gitlab # [ 0.615415] acpiphp: Slot [29] registered gitlab # [ 0.616176] acpiphp: Slot [30] registered gitlab # [ 0.617433] acpiphp: Slot [31] registered gitlab # [ 0.618178] PCI host bridge to bus 0000:00 gitlab # [ 0.618400] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.620396] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.621396] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.622396] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.623395] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.625396] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.626723] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.627892] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.629842] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.633426] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.634356] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.635321] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.636271] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.637383] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.638428] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.641448] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.643324] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.644687] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.646402] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.647641] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.658255] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.660272] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.661214] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.662447] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.664164] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.668486] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.670403] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.671394] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.683425] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.686490] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.693443] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.695419] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.698459] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.704553] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.711421] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.714419] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.716458] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.722845] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.729429] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.731413] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.733443] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.737927] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.746419] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.747355] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.748458] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.754691] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.764426] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.766412] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.767443] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.773506] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.781431] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.783416] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.785454] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.788416] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.794563] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.799399] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.801443] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.806391] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.811431] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.813411] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.815442] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.820391] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.829422] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.831421] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.834475] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.846922] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.849793] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.851738] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.854762] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.857687] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.863419] iommu: Default domain type: Translated gitlab # [ 0.865403] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.868892] ACPI: bus type USB registered gitlab # [ 0.870534] usbcore: registered new interface driver usbfs gitlab # [ 0.871473] usbcore: registered new interface driver hub gitlab # [ 0.873143] usbcore: registered new device driver usb gitlab # [ 0.875696] NetLabel: Initializing gitlab # [ 0.877404] NetLabel: domain hash size = 128 gitlab # [ 0.879402] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.882620] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.884446] PCI: Using ACPI for IRQ routing gitlab # [ 0.888472] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.889391] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.889391] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.896419] vgaarb: loaded gitlab # [ 0.898011] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.900399] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.907843] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.915201] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.917336] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.921616] pnp: PnP ACPI init gitlab # [ 0.924733] pnp: PnP ACPI: found 6 devices gitlab # [ 0.938239] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.942284] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.945240] NET: Registered PF_INET protocol family gitlab # [ 0.950701] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.984071] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.985651] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.987054] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.990857] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.992253] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.993792] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.995475] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.996962] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.998367] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.999372] NET: Registered PF_XDP protocol family gitlab # [ 1.000265] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 1.001322] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 1.002387] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 1.003561] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 1.004717] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 1.006108] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 1.007136] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 1.009481] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 1.011998] PCI: CLS 0 bytes, default 64 gitlab # [ 1.012802] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 1.013275] Trying to unpack rootfs image as initramfs... gitlab # [ 1.013901] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 1.016659] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns gitlab # [ 1.037498] Initialise system trusted keyrings gitlab # [ 1.038767] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 1.050228] Key type asymmetric registered gitlab # [ 1.050969] Asymmetric key parser 'x509' registered gitlab # [ 1.051887] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 1.053455] io scheduler mq-deadline registered gitlab # [ 1.054291] io scheduler kyber registered gitlab # [ 1.058414] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 1.059734] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 1.062158] Linux agpgart interface v0.103 gitlab # [ 1.062957] ACPI: bus type drm_connector registered gitlab # [ 1.065470] usbcore: registered new interface driver usbserial_generic gitlab # [ 1.066596] usbserial: USB Serial support registered for generic gitlab # [ 1.067644] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 1.067644] Please enable it if your BIOS has the CPPC option. gitlab # [ 1.069971] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 1.071618] drop_monitor: Initializing network drop monitor service gitlab # [ 1.072889] NET: Registered PF_INET6 protocol family gitlab # [ 1.074717] Segment Routing with IPv6 gitlab # [ 1.075428] In-situ OAM (IOAM) with IPv6 gitlab # [ 1.077364] IPI shorthand broadcast: enabled gitlab # [ 1.081658] sched_clock: Marking stable (934010404, 147084305)->(1104815526, -23720817) gitlab # [ 1.083496] registered taskstats version 1 gitlab # [ 1.084557] Loading compiled-in X.509 certificates gitlab # [ 1.094630] Demotion targets for Node 0: null gitlab # [ 1.095794] Key type .fscrypt registered gitlab # [ 1.096508] Key type fscrypt-provisioning registered gitlab # [ 1.097450] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.098388] ima: Allocated hash algorithm: sha1 gitlab # [ 1.099234] ima: No architecture policies found gitlab # [ 1.100331] PM: Magic number: 10:639:621 gitlab # [ 1.102019] RAS: Correctable Errors collector initialized. gitlab # [ 1.106573] clk: Disabling unused clocks gitlab # [ 1.107322] PM: genpd: Disabling unused power domains gitlab # [ 1.334314] Freeing initrd memory: 29392K gitlab # [ 1.341503] Freeing unused decrypted memory: 2028K gitlab # [ 1.347878] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.350579] Write protecting the kernel read-only data: 32768k gitlab # [ 1.355559] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.359625] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.428141] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.429342] Run /init as init process gitlab # [ 1.442305] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.465903] fuse: init (API version 7.45) gitlab # [ 1.474292] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.481988] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.485559] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.537011] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.873759] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.914563] systemd[1]: Detected virtualization kvm. gitlab # [ 1.916828] systemd[1]: Detected architecture x86-64. gitlab # [ 1.919000] systemd[1]: Running in initrd. gitlab # [ 1.921641] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.924724] systemd[1]: Hostname set to . gitlab # [ 2.036278] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 2.079743] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 2.090612] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 2.091809] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 2.093277] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 2.094458] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 2.095590] systemd[1]: Reached target Path Units. gitlab # [ 2.096505] systemd[1]: Reached target Slice Units. gitlab # [ 2.097386] systemd[1]: Reached target Swaps. gitlab # [ 2.098243] systemd[1]: Reached target Timer Units. gitlab # [ 2.099249] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 2.100495] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 2.101629] systemd[1]: Listening on Journal Sockets. gitlab # [ 2.102632] systemd[1]: Listening on udev Control Socket. gitlab # [ 2.103654] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 2.104605] systemd[1]: Reached target Socket Units. gitlab # [ 2.106494] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 2.108611] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 2.110446] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 2.115162] systemd[1]: Starting Journal Service... gitlab # [ 2.117239] systemd[1]: Starting Load Kernel Modules... gitlab # [ 2.118298] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 2.123369] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.125479] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.128149] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.130549] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.134602] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.141467] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.141532] systemd-journald[91]: Collecting audit messages is disabled. gitlab # [ 2.151159] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.157242] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 2.167028] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 2.169346] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 2.170145] netfs: FS-Cache loaded gitlab # [ 2.177065] 9pnet: Installing 9P2000 support gitlab # [ 2.178495] systemd[1]: Finished Load Kernel Modules. gitlab # [ 2.180053] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 2.182290] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 2.184224] systemd[1]: Reached target Local File Systems. gitlab # [ 2.186104] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 2.187972] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 2.191468] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 2.195421] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 2.048398] systemd-modules-load[93]: Using 4[ 2.196737] systemd[1]: Started Journal Service. gitlab # probe threads gitlab # [ 2.051254] systemd-modules-load[93]: Inserted module 'virtio_balloon' gitlab # [ 2.052581] systemd-modules-load[93]: Inserted module 'virtio_gpu' gitlab # [ 2.053738] systemd-modules-load[93]: Inserted module 'dm_mod' gitlab # [ 2.054761] systemd[1]: Starting Create System Files and Directories... gitlab # [ 2.061630] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 2.065229] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.072270] systemd-udevd[104]: Using default interface naming scheme 'v261'. gitlab # [ 2.082762] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.118372] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.119483] systemd[1]: Reached target System Initialization. gitlab # [ 2.120336] systemd[1]: Reached target Basic System. gitlab # [ 2.351795] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.358438] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.358643] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.361862] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.362978] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.364343] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.365419] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.366591] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.367673] usb usb1: Product: UHCI Host Controller gitlab # [ 2.368339] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.369244] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.372360] SCSI subsystem initialized gitlab # [ 2.372420] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.375674] virtio_blk virtio5: [vdb] 11842616 512-byte logical blocks (6.06 GB/5.65 GiB) gitlab # [ 2.380819] hub 1-0:1.0: USB hub found gitlab # [ 2.382127] hub 1-0:1.0: 2 ports detected gitlab # [ 2.386208] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.389427] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.390477] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.288123] (udev-worker)[138]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.291189] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.298168] (udev-worker)[132]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.301202] (udev-worker)[132]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.448281] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.449291] scsi host0: ata_piix gitlab # [ 2.453178] scsi host1: ata_piix gitlab # [ 2.453855] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.455567] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.317098] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.318256] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.319148] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.319974] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.321981] systemd-vconsole-setup[145]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.326592] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.341314] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.344857] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.608340] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.616427] ata2: found unknown device (class 0) gitlab # [ 2.619327] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.623614] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.678431] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.705860] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.775535] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.778574] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.781275] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.783212] usb 1-1: Manufacturer: QEMU gitlab # [ 2.784715] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.818203] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.831800] usbcore: registered new interface driver usbhid gitlab # [ 2.834001] usbhid: USB HID core driver gitlab # [ 2.845327] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.848976] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.981296] systemd[1]: Mounting /sysroot... gitlab # [ 3.278331] EXT4-fs (vda): mounted filesystem daec9de0-3e92-40d8-b97a-fb69154c62ba r/w with ordered data mode. Quota mode: none. gitlab # [ 3.138482] systemd[1]: Mounted /sysroot. gitlab # [ 3.140906] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.146384] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.150068] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.169274] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.171469] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.177312] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.183182] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.187415] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.196394] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.201120] systemd[1]: Mounted /sysroot/run.[ 3.348551] 9p: Installing v9fs 9p2000 file system support gitlab # gitlab # [ 3.204556] systemd-sysroot-fstab-check[181]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.354500] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.208867] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.211664] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.213523] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.215462] systemd[1]: Reload requested from client PID 181 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.218633] systemd[1]: Reloading... gitlab # [ 3.272223] systemd[1]: Reloading finished in 58 ms. gitlab # [ 3.299126] systemd-sysroot-fstab-check[181]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.301900] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.303586] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.305369] systemd-sysroot-fstab-check[181]: Requesting swap.target/start/replace... gitlab # [ 3.307902] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.310241] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.312468] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.315057] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.341336] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.343752] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.981565] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 4.031409] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 4.033304] systemd[1]: Reached target Initrd File Systems. gitlab # [ 4.035610] systemd[1]: Starting Find NixOS closure... gitlab # [ 4.037564] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 4.054131] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 4.056713] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 4.078813] systemd[1]: Finished Find NixOS closure. gitlab # [ 4.080418] systemd[1]: Reached target Initrd Default Target. gitlab # [ 4.082115] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.110494] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.112227] systemd[1]: Stopped target Basic System. gitlab # [ 4.113710] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.115311] systemd[1]: Stopped target Path Units. gitlab # [ 4.116971] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.119354] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.122836] systemd[1]: Stopped target Slice Units. gitlab # [ 4.124685] systemd[1]: Stopped target Socket Units. gitlab # [ 4.126528] systemd[1]: Stopped target System Initialization. gitlab # [ 4.128594] systemd[1]: Stopped target Swaps. gitlab # [ 4.130798] systemd[1]: Stopped target Timer Units. gitlab # [ 4.132890] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.135444] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.137371] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.140148] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.141788] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.145075] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.146829] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.148525] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.149765] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.151443] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.152688] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.154532] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.156347] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.158134] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.159749] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.161063] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.162660] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.164340] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.165649] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.167089] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.168070] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.168746] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.169586] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.170464] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.171470] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.172207] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.173035] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.173962] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.174967] systemd[1]: Closed udev Control Socket. gitlab # [ 4.175643] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.176316] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.177278] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.178125] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.179157] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.180062] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.180944] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.181791] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.182824] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.183563] systemd[1]: Reached target Switch Root. gitlab # [ 4.184184] systemd[1]: Starting NixOS Activation... gitlab # [ 4.301102] initrd-nixos-activation-start[231]: booting system configuration /nix/store/xal4vpl68x4dbl25bxq3admdybqpgc2a-nixos-system-gitlab-test gitlab # [ 4.344757] initrd-nixos-activation-start[231]: running activation script... gitlab # [ 4.586586] initrd-nixos-activation-start[254]: setting up /etc... gitlab # [ 4.708471] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.710994] systemd[1]: Finished NixOS Activation. gitlab # [ 4.712649] systemd[1]: Starting Switch Root... gitlab # [ 4.729329] systemd[1]: Switching root. gitlab # [ 4.928533] systemd-journald[91]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.068447] NET: Registered PF_VSOCK protocol family gitlab # [ 5.450390] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.460651] systemd[1]: Detected virtualization kvm. gitlab # [ 5.462527] systemd[1]: Detected architecture x86-64. gitlab # [ 5.464540] systemd[1]: Detected first boot. gitlab # [ 5.466964] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.613661] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.687917] systemd[1]: Applying preset policy. gitlab # [ 5.828660] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 5.950877] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 5.952287] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 5.954305] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 5.956552] systemd[1]: Created slice Slice /system/getty. gitlab # [ 5.957949] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 5.959760] systemd[1]: Created slice User and Session Slice. gitlab # [ 5.960676] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.961979] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 5.963253] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 5.963971] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 5.964747] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 5.965583] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 5.966329] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 5.967189] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 5.968081] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 5.969003] systemd[1]: Reached target Path Units. gitlab # [ 5.969807] systemd[1]: Reached target Remote File Systems. gitlab # [ 5.970722] systemd[1]: Reached target Slice Units. gitlab # [ 5.971476] systemd[1]: Reached target Swaps. gitlab # [ 5.972894] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 5.974844] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 5.976299] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 5.977865] systemd[1]: Listening on Factory Reset Management. gitlab # [ 5.978841] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 5.981154] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 5.982502] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 5.984109] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 5.985260] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 5.986380] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.987870] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 5.990644] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 5.991704] systemd[1]: Listening on udev Control Socket. gitlab # [ 5.992650] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 5.995185] systemd[1]: Mounting Huge Pages File System... gitlab # [ 5.997463] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 5.999822] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.002029] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.006273] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.008975] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 6.020587] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 6.021870] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.037343] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.039489] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.042152] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.043386] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.053126] systemd[1]: Starting Journal Service... gitlab # [ 6.055469] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.057876] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.061193] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.062539] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.066106] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.069725] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.071170] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.072379] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.074166] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.075541] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.077718] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.079348] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 6.082514] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 6.083912] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.088173] systemd-journald[325]: Collecting audit messages is enabled. gitlab # [ 6.091147] EXT4-fs (vda): re-mounted daec9de0-3e92-40d8-b97a-fb69154c62ba. gitlab # [ 6.091420] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.104195] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 5.961280] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.108263] loop: module loaded gitlab # [ 5.963372] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 5.966365] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 6.114412] systemd[1]: Started Journal Service. gitlab # [ 5.968579] systemd-modules-load[326]: Using 3 probe threads gitlab # [ 5.969788] systemd-modules-load[326]: Inserted module 'tls' gitlab # [ 5.971281] systemd-modules-load[326]: Inserted module 'loop' gitlab # [ 5.972530] systemd-oomd[327]: No swap; memory pressure usage will be degraded gitlab # [ 5.974110] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 5.975335] systemd[1]: Finished Load Kernel Modules. gitlab # [ 5.976330] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 5.977522] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 5.978592] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 5.979685] systemd[1]: Starting Firewall... gitlab # [ 5.980625] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 5.981725] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 5.989341] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 5.993093] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 5.994097] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.997671] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.148705] systemd-journald[325]: Received client request to flush runtime journal. gitlab # [ 6.039333] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.040483] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.041355] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.042434] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.043320] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.044481] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.045455] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.046797] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.053236] systemd-udevd[358]: Using default interface naming scheme 'v261'. gitlab # [ 6.071252] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 6.085877] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.160783] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.178050] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.237662] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.239350] (udev-worker)[413]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.241491] (udev-worker)[413]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.242924] (udev-worker)[415]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.260852] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.262652] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.264238] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.266411] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.268230] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.269522] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.420192] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.426616] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.434394] ACPI: button: Power Button [PWRF] gitlab # [ 6.439369] Console: switching to colour dummy device 80x25 gitlab # [ 6.440687] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.440690] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.443612] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.444459] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.449397] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.457773] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.468774] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.470841] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.476109] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.477831] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 6.481700] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.482645] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.493440] FDC 0 is a S82078B gitlab # [ 6.494739] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.496257] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.496796] rtc_cmos 00:05: setting system clock to 2026-09-04T07:38:47 UTC (1788507527) gitlab # [ 6.498297] systemd-journald[325]: Time jumped backwards, rotating. gitlab # [ 6.498452] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.514512] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.515817] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6 gitlab # [ 6.517556] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 gitlab # [ 6.379044] systemd[1]: Finished Firewall. gitlab # [ 6.451400] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.466274] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.467467] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.470819] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.618820] ppdev: user-space parallel port driver gitlab # [ 6.481419] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.482636] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.484261] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.650450] kvm_amd: TSC scaling supported gitlab # [ 6.650895] kvm_amd: Nested Virtualization enabled gitlab # [ 6.651609] kvm_amd: Nested Paging enabled gitlab # [ 6.652176] kvm_amd: LBR virtualization supported gitlab # [ 6.652722] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.653440] kvm_amd: Virtual GIF supported gitlab # [ 6.653964] kvm_amd: Virtual NMI enabled gitlab # [ 6.685105] EDAC MC: Ver: 3.0.0 gitlab # [ 6.562762] systemd-vconsole-setup[497]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.565150] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.808650] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.831116] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.832912] systemd[1]: Reached target Local File Systems. gitlab # [ 6.834943] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.837730] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.840438] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.842567] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.845591] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.853223] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.895760] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.898354] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.900651] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.908768] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.911639] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 6.927472] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 6.939455] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 6.943168] systemd[1]: Starting Update is Completed... gitlab # [ 6.955784] systemd[1]: Finished Update is Completed. gitlab # [ 7.003443] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.005670] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.261303] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.263639] systemd[1]: Reached target System Initialization. gitlab # [ 7.265873] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.268537] systemd[1]: Started logrotate.timer. gitlab # [ 7.270404] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.272863] systemd[1]: Reached target Timer Units. gitlab # [ 7.274828] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.277320] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.279719] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.281937] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.285596] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.288232] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.290329] systemd[1]: Reached target Socket Units. gitlab # [ 7.345081] dbus-broker-launch[579]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.348363] dbus-broker-launch[579]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.351110] dbus-broker-launch[579]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.356552] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.366098] dbus-broker-launch[579]: Ready gitlab # [ 7.368823] systemd[1]: Reached target Basic System. gitlab # [ 7.370578] systemd[1]: Started backdoor.service. gitlab # [ 7.373139] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.374834] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.379670] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.390370] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.398765] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.401815] logrotate[584]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 7.407499] logrotate[584]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # [ 7.410136] logrotate[584]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.412230] systemd[1]: Started Reset console on configuration changes. gitlab # connecting to host... gitlab # [ 7.415364] logrotate[584]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.417957] logrotate[584]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.420048] logrotate[584]: Allocating hash table for state file, size 64 entries gitlab # [ 7.420827] logrotate[584]: Handling 4 logs gitlab # [ 7.422039] logrotate[584]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.422921] logrotate[584]: considering log /var/log/btmp gitlab # [ 7.423551] logrotate[584]: Creating new state gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.424846] logrotate[584]: Now: 2026-09-04 07:38 gitlab # [ 7.425791] logrotate[584]: Last rotated at 2026-09-04 07:00 gitlab: connected to guest root shell gitlab # [ 7.427020] logrotate[584]: log does not need rotating (log has already been rotated) gitlab: (connecting took 8.04 seconds) gitlab # [ 7.427911] logrotate[584]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab: (finished: waiting for the VM to finish booting, in 8.04 seconds) gitlab # [ 7.428844] logrotate[584]: considering log /var/log/wtmp gitlab # [ 7.429699] logrotate[584]: Creating new state gitlab # [ 7.430143] logrotate[584]: Now: 2026-09-04 07:38 gitlab # [ 7.430593] logrotate[584]: Last rotated at 2026-09-04 07:00 gitlab # [ 7.431059] logrotate[584]: log does not need rotating (log has already been rotated) gitlab # [ 7.431491] logrotate[584]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.431944] logrotate[584]: switching euid from 0 to 165 and egid from 0 to 165 (pid 584) gitlab # [ 7.432535] logrotate[584]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.432988] logrotate[584]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.433656] logrotate[584]: Creating new state gitlab # [ 7.434104] logrotate[584]: switching euid from 165 to 0 and egid from 165 to 0 (pid 584) gitlab # [ 7.434545] logrotate[584]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.435019] logrotate[584]: switching euid from 0 to 60 and egid from 0 to 60 (pid 584) gitlab # [ 7.435467] logrotate[584]: considering log /var/log/nginx/*.log gitlab # [ 7.435909] logrotate[584]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.436499] logrotate[584]: Creating new state gitlab # [ 7.436972] logrotate[584]: not running postrotate script, since no logs were rotated gitlab # [ 7.437581] logrotate[584]: switching euid from 60 to 0 and egid from 60 to 0 (pid 584) gitlab # [ 7.438077] systemd[1]: Starting resolvconf update... gitlab # [ 7.453528] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.453967] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.457436] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.472958] nsncd[585]: Sep 04 07:38:48.622 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.475322] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.476393] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.477390] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.478298] systemd[1]: Starting User Login Management... gitlab # [ 7.503700] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.505244] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.506219] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.507246] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.508122] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.509331] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.511666] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.511815] systemd[1]: nscd.service: Consumed 28ms CPU time over 119ms wall clock time, 7.3M memory peak, 5.5M read from disk. gitlab # [ 7.515194] systemd-logind[639]: New seat seat0. gitlab # [ 7.516528] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.520026] systemd-logind[639]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.520523] systemd-logind[639]: Watching system buttons on /dev/input/event4 (QEMU Virtio Keyboard) gitlab # [ 7.520983] systemd-logind[639]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.523616] systemd[1]: Started User Login Management. gitlab # [ 7.526352] systemd[1]: Starting linger-users.service... gitlab # [ 7.534203] systemd[1]: Finished resolvconf update. gitlab # [ 7.535340] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.536674] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.537913] nsncd[677]: Sep 04 07:38:48.685 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.540225] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.540505] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.540979] systemd[1]: Starting DHCP Client... gitlab # [ 7.543524] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.544123] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.546238] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.558861] systemd[1]: Finished linger-users.service. gitlab # [ 7.579339] network-addresses-eth1-start[701]: adding address 192.168.1.1/24... done gitlab # [ 7.583719] network-addresses-eth1-start[701]: adding address 2001:db8:1::1/64... done gitlab # [ 7.589831] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.622935] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.624621] systemd[1]: Reached target Network. gitlab # [ 7.627252] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.629866] dhcpcd[726]: dhcpcd-10.3.2 starting gitlab # [ 7.632216] dhcpcd[769]: dev: loaded udev gitlab # [ 7.632567] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.636424] systemd[1]: Starting PostgreSQL Server... gitlab # [ 7.785772] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.638795] systemd[1]: Starting Redis Server - redis-gitlab.[ 7.786530] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # .. gitlab # [ 7.640172] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.652315] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.666842] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.669958] systemd[1]: Started Getty on tty1. gitlab # [ 7.671433] systemd[1]: Reached target Login Prompts. gitlab # [ 7.875644] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 7.891214] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 7.892280] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 7.894097] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 7.895299] cfg80211: failed to load regulatory.db gitlab # [ 7.763746] nginx-pre-start[793]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.765783] nginx-pre-start[793]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.771142] systemd[1]: Started Nginx Web Server. gitlab # [ 7.918669] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.773889] dhcpcd[769]: eth0: waiting for carrier gitlab # [ 7.774892] dhcpcd[769]: eth0: carrier acquired gitlab # [ 7.781313] redis-server[791]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.783537] redis-server[791]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.784756] redis-server[791]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=791, just started gitlab # [ 7.786585] redis-server[791]: Configuration loaded gitlab # [ 7.787610] redis[791]: monotonic clock: POSIX clock_gettime gitlab # [ 7.789178] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.790225] dhcpcd[769]: DUID 00:01:00:01:32:2d:32:08:52:54:00:12:34:56 gitlab # [ 7.791456] dhcpcd[769]: eth0: IAID 00:12:34:56 gitlab # [ 7.792309] dhcpcd[769]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.793493] redis[791]: Running mode=standalone, port=0. gitlab # [ 7.795201] postgresql-pre-start[794]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.796976] postgresql-pre-start[794]: This user must also own the server process. gitlab # [ 7.798252] redis[791]: Server initialized gitlab # [ 7.799247] postgresql-pre-start[794]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.800653] postgresql-pre-start[794]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.801933] postgresql-pre-start[794]: The default text search configuration will be set to "english". gitlab # [ 7.803328] postgresql-pre-start[794]: Data page checksums are enabled. gitlab # [ 7.804325] postgresql-pre-start[794]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.805789] postgresql-pre-start[794]: creating subdirectories ... ok gitlab # [ 7.806734] postgresql-pre-start[794]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.808118] redis[791]: Ready to accept connections unix gitlab # [ 7.809119] redis[791]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.826454] postgresql-pre-start[794]: selecting default "max_connections" ... 100 gitlab # [ 7.873295] postgresql-pre-start[794]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.114116] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.258647] postgresql-pre-start[794]: selecting default time zone ... UTC gitlab # [ 8.260344] postgresql-pre-start[794]: creating configuration files ... ok gitlab # [ 8.431967] postgresql-pre-start[794]: running bootstrap script ... ok gitlab # [ 8.473590] gitlab-workhorse[827]: time="2026-09-04T07:38:49Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.475337] gitlab-workhorse[827]: time="2026-09-04T07:38:49Z" level=info msg="Using redis/go-redis" gitlab # [ 8.476707] gitlab-workhorse[827]: time="2026-09-04T07:38:49Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.692224] dhcpcd[769]: eth0: soliciting a DHCP lease gitlab # [ 8.849759] NET: Registered PF_PACKET protocol family gitlab # [ 8.713127] dhcpcd[769]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 8.717311] dhcpcd[769]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.843480] postgresql-pre-start[794]: performing post-bootstrap initialization ... ok gitlab # [ 9.088389] postgresql-pre-start[794]: syncing data to disk ... ok gitlab # [ 9.089236] postgresql-pre-start[794]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 9.090982] postgresql-pre-start[794]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 9.092922] postgresql-pre-start[794]: Success. You can now start the database server using: gitlab # [ 9.094462] postgresql-pre-start[794]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 9.226600] postgres[853]: [853] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 9.227407] postgres[853]: [853] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 9.228604] postgres[853]: [853] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 9.230262] postgres[853]: [853] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 9.238626] postgres[866]: [866] LOG: database system was shut down at 2026-09-04 07:38:49 GMT gitlab # [ 9.247084] postgres[853]: [853] LOG: database system is ready to accept connections gitlab # [ 9.250964] systemd[1]: Started PostgreSQL Server. gitlab # [ 9.253445] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 9.401797] postgresql-setup-start[878]: CREATE DATABASE gitlab # [ 9.409725] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[860]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 9.412179] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[860]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 9.420135] postgresql-setup-start[885]: CREATE ROLE gitlab # [ 9.428615] postgresql-setup-start[889]: ALTER DATABASE gitlab # [ 9.446439] postgresql-setup-start[899]: CREATE ROLE gitlab # [ 9.448693] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 9.449266] systemd[1]: Reached target PostgreSQL. gitlab # [ 9.450701] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.477498] systemd[1]: Finished gitlab-config.service. gitlab # [ 9.480112] systemd[1]: Started gitaly.service. gitlab # [ 9.482613] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 9.552287] gitlab-postgresql-start[914]: CREATE DATABASE gitlab # [ 9.580288] gitlab-postgresql-start[929]: CREATE EXTENSION gitlab # [ 9.652373] gitlab-postgresql-start[931]: CREATE EXTENSION gitlab # [ 9.654852] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 9.657468] dhcpcd[769]: eth0: soliciting an IPv6 router gitlab # [ 9.658276] dhcpcd[769]: eth0: Router Advertisement from fe80::2 gitlab # [ 9.659219] dhcpcd[769]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 9.659843] dhcpcd[769]: eth0: adding route to fec0::/64 gitlab # [ 9.660753] dhcpcd[769]: eth0: adding default route via fe80::2 gitlab # [ 9.996831] gitaly[907]: time="2026-09-04T07:38:51.146Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=907 gitlab # [ 9.997615] gitaly[907]: time="2026-09-04T07:38:51.146Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=907 gitlab # [ 9.998458] gitaly[907]: time="2026-09-04T07:38:51.146Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=907 gitlab # [ 9.999033] gitaly[907]: time="2026-09-04T07:38:51.146Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=907 gitlab # [ 9.999642] gitaly[907]: time="2026-09-04T07:38:51.146Z" level=info msg="Starting Gitaly" pid=907 version= gitlab # [ 10.155411] gitaly[907]: time="2026-09-04T07:38:51.305Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=149 pid=907 gitlab # [ 10.156220] gitaly[907]: time="2026-09-04T07:38:51.305Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=907 gitlab # [ 10.156781] gitaly[907]: time="2026-09-04T07:38:51.305Z" level=info msg="finished initializing command factory" duration_ms=0 pid=907 gitlab # [ 10.157561] gitaly[907]: time="2026-09-04T07:38:51.306Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-907/git-exec-2846255476.d/git pid=907 gitlab # [ 10.166573] gitaly[907]: time="2026-09-04T07:38:51.316Z" level=info msg="finished detecting git version" duration_ms=10 pid=907 gitlab # [ 10.166950] gitaly[907]: time="2026-09-04T07:38:51.316Z" level=info msg="using Git version" pid=907 version=2.53.g gitlab # [ 10.168132] gitaly[907]: time="2026-09-04T07:38:51.317Z" level=info msg="clearing disk cache object folder" pid=907 storage=default gitlab # [ 10.168558] gitaly[907]: time="2026-09-04T07:38:51.317Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache71339932 pid=907 storage=default gitlab # [ 10.169061] gitaly[907]: time="2026-09-04T07:38:51.317Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache71339932 pid=907 storage=default gitlab # [ 10.169585] gitaly[907]: time="2026-09-04T07:38:51.317Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=907 gitlab # [ 10.172058] gitaly[907]: time="2026-09-04T07:38:51.317Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=907 gitlab # [ 10.172439] gitaly[907]: time="2026-09-04T07:38:51.317Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache71339932 clear_duration_ms=0 pid=907 storage=default gitlab # [ 10.209408] gitaly[907]: time="2026-09-04T07:38:51.359Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=907 gitlab # [ 10.209584] gitaly[907]: time="2026-09-04T07:38:51.359Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=907 schema=unix gitlab # [ 10.210130] gitaly[907]: time="2026-09-04T07:38:51.359Z" level=info msg="listening at address" address=/run/gitaly/gitaly-907/sock.d/intern pid=907 schema=unix gitlab # [ 10.210853] gitaly[907]: time="2026-09-04T07:38:51.361Z" level=info msg="finished tempdir cleaner walk" pid=907 storage=default time_ms=0 gitlab # [ 10.217097] gitaly[907]: time="2026-09-04T07:38:51.367Z" level=info msg="counting repositories" pid=907 gitlab # [ 10.217786] gitaly[907]: time="2026-09-04T07:38:51.367Z" level=info msg="starting to count repositories" pid=907 storage_path=/var/gitlab/state/repositories gitlab # [ 10.220554] gitaly[907]: time="2026-09-04T07:38:51.370Z" level=info msg="completed counting repositories" counting_duration_ms=3 pid=907 storage_path=/var/gitlab/state/repositories gitlab # [ 10.220850] gitaly[907]: time="2026-09-04T07:38:51.370Z" level=info msg="completed counting all repositories" counting_duration=3 pid=907 gitlab # [ 10.222052] gitaly[907]: time="2026-09-04T07:38:51.371Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=907 gitlab # [ 10.222746] gitaly[907]: time="2026-09-04T07:38:51.371Z" level=info msg="Started Gitaly" duration_ms=224 pid=907 gitlab # [ 10.223397] gitaly[907]: time="2026-09-04T07:38:51.371Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=907 gitlab # [ 10.224150] gitaly[907]: time="2026-09-04T07:38:51.374Z" level=info msg="maintenance: daily scheduled" pid=907 scheduled="2026-09-04 12:00:00 +0000 UTC" gitlab # [ 11.155904] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.162258] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.197825] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.178305] gitaly[907]: time="2026-09-04T07:38:53.327Z" level=info msg="License database preloaded" duration_ms=2180 pid=907 gitlab # [ 13.713305] dhcpcd[769]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.714179] dhcpcd[769]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.715566] dhcpcd[769]: eth0: adding default route via 10.0.2.2 gitlab # [ 13.833431] systemd[1]: Started DHCP Client. gitlab # [ 13.836231] systemd[1]: Reached target Network is Online. gitlab # [ 40.886124] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[916]: W, [2026-09-04T07:39:22.035427 #916] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 43.138851] postgres[1312]: [1312] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 43.139926] postgres[1312]: [1312] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 43.140602] postgres[1312]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 43.141583] postgres[1312]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 43.142511] postgres[1312]: attidentity AS identity, gitlab # [ 43.143534] postgres[1312]: attgenerated as attgenerated gitlab # [ 43.144565] postgres[1312]: FROM pg_attribute a gitlab # [ 43.145549] postgres[1312]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 43.146313] postgres[1312]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 43.147305] postgres[1312]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 43.148176] postgres[1312]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 43.148981] postgres[1312]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 43.149857] postgres[1312]: ORDER BY a.attnum gitlab # [ 43.150991] postgres[1312]: gitlab # [ 46.599698] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1354]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 46.600225] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1354]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 48.531357] gitlab-workhorse[827]: time="2026-09-04T07:39:29Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 58.540143] gitlab-workhorse[827]: time="2026-09-04T07:39:39Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 61.193937] postgres[1420]: [1420] ERROR: relation "table_without_models" does not exist gitlab # [ 61.194747] postgres[1420]: [1420] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.551537] gitlab-workhorse[827]: time="2026-09-04T07:39:49Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 73.078163] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 73.079921] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 73.081904] systemd[1]: Starting gitlab.service... gitlab # [ 73.449761] bundle[1587]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 73.450534] bundle[1587]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 73.452099] bundle[1587]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 76.133142] sidekiq-cluster[1586]: {"severity":"INFO","time":"2026-09-04T07:39:57.266Z","message":"Starting cluster with 1 processes"} gitlab # [ 76.231994] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.360Z","pid":1587,"message":"* Enabling systemd notification integration"} gitlab # [ 76.232667] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.381Z","pid":1587,"message":"Puma starting in cluster mode..."} gitlab # [ 76.233579] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.381Z","pid":1587,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 76.234525] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.381Z","pid":1587,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 76.235477] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.381Z","pid":1587,"message":"* Min threads: 0"} gitlab # [ 76.236219] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.381Z","pid":1587,"message":"* Max threads: 4"} gitlab # [ 76.236862] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.381Z","pid":1587,"message":"* Environment: production"} gitlab # [ 76.237617] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.381Z","pid":1587,"message":"* Master PID: 1587"} gitlab # [ 76.238264] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.381Z","pid":1587,"message":"* Workers: 2"} gitlab # [ 76.238966] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.381Z","pid":1587,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 76.239605] bundle[1587]: {"timestamp":"2026-09-04T07:39:57.381Z","pid":1587,"message":"* Preloading application"} gitlab # [ 78.561088] gitlab-workhorse[827]: time="2026-09-04T07:39:59Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 88.570996] gitlab-workhorse[827]: time="2026-09-04T07:40:09Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.572209] gitlab-workhorse[827]: time="2026-09-04T07:40:19Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.651965] bundle[1587]: W, [2026-09-04T07:40:19.801448 #1587] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 100.694995] sidekiq-cluster[1617]: 2026-09-04T07:40:21.844Z pid=1617 tid=wl5 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1617, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>435970048} gitlab # [ 100.863097] sidekiq-cluster[1617]: W, [2026-09-04T07:40:22.013078 #1617] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 100.901266] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:22.051Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 102.763322] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.912Z","message":"GitLab reliable fetch activated!"} gitlab # [ 102.767109] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.912Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 102.784522] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.934Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 102.789997] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.936Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 102.790317] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.939Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 102.791542] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.941Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 102.793449] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.943Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 102.814441] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.964Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 102.819590] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.968Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 102.821285] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.971Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 102.824740] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.974Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 102.828848] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.979Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 102.832991] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.983Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 102.837883] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.988Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 102.842235] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.992Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 102.846134] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:23.996Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 102.850625] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.000Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 102.855174] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.005Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 102.862209] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.012Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 102.868310] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.018Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 102.874708] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.024Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 102.880873] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.030Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 102.888311] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.038Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 102.894641] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.044Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 102.899167] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.049Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 102.900763] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.050Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 102.902562] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.052Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 102.904647] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.054Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 102.906756] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.056Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 102.908860] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.059Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 102.911100] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.061Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 102.913298] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.063Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 102.915100] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.065Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 102.918067] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.068Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 102.920201] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.070Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 102.922499] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.072Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 102.924906] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.075Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 102.927103] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.077Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 102.929829] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.079Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 102.932062] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.082Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 102.934405] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.084Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 102.936571] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.086Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 102.938982] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.089Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 102.942709] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.092Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 102.946514] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.096Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 102.950230] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.100Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 102.954482] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.104Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 102.959108] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.109Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 102.962643] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.112Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 102.966480] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.116Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 102.970618] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.120Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 102.976666] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.126Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 102.981707] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.131Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 102.987523] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.137Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 103.001269] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.151Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 103.005503] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.155Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 103.009363] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.159Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 103.013238] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.163Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 103.016893] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.167Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 103.023481] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.173Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 103.028226] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.178Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 103.033814] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.183Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 103.038792] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.188Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 103.043466] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.193Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 103.049739] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.199Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 103.055956] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.206Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 103.061566] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.211Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 103.069242] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.219Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 103.074501] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.224Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 103.079429] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.229Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 103.084663] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.234Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 103.089960] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.240Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 103.095200] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.245Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 103.100333] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.250Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 103.105315] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.255Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 103.110716] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.260Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 103.115881] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.265Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 103.121935] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.272Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 103.128435] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.278Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 103.134577] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.284Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 103.139921] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.290Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 103.145616] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.295Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 103.150805] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.300Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 103.156595] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.306Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 103.163518] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.313Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 103.169705] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.319Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 103.175682] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.325Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 103.180847] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.330Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 103.187908] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.338Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 103.193528] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.343Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 103.199443] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.349Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 103.204893] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.354Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 103.210587] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.360Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 103.215595] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.365Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 103.221574] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.371Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 103.226956] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.377Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 103.233767] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.383Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 103.240816] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.390Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 103.246592] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.396Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 103.251563] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.401Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 103.261755] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.411Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 103.266730] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.416Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 103.271716] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.421Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 103.278278] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.428Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 103.283969] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.434Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 103.289710] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.439Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 103.295775] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.445Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 103.300475] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.450Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 103.305417] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.455Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 103.312081] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.462Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 103.317065] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:24.467Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 108.589802] gitlab-workhorse[827]: time="2026-09-04T07:40:29Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 118.590665] gitlab-workhorse[827]: time="2026-09-04T07:40:39Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 127.115218] postgres[2055]: [2055] ERROR: relation "table_without_models" does not exist gitlab # [ 127.116077] postgres[2055]: [2055] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 128.591353] gitlab-workhorse[827]: time="2026-09-04T07:40:49Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 129.346885] postgres[2075]: [2075] ERROR: relation "table_without_models" does not exist gitlab # [ 129.347131] postgres[2075]: [2075] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 129.675513] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:50.825Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 129.679541] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:50.829Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 129.679816] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:50.829Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 129.680472] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:50.829Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 129.686268] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:50.836Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 130.979642] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:52.129Z","message":"Cleaning working queues"} gitlab # [ 130.981849] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:52.131Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6cd500f64f61e80fecc57e7c","created_at":"2026-09-04T07:39:53.888Z","trace_propagation_headers":{"sentry-trace":"4704d54a555a4ce6a25883b8de580de9-58bc3d4df0994711","baggage":"sentry-trace_id=4704d54a555a4ce6a25883b8de580de9,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2a38da1741e30fd64194e24417322400","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:39:53.895Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6cd500f64f61e80fecc57e7c: start","job_status":"start","queue_duration_s":58.23633,"scheduling_latency_s":58.236368} gitlab # [ 131.124463] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:40:52.274Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6cd500f64f61e80fecc57e7c","created_at":"2026-09-04T07:39:53.888Z","trace_propagation_headers":{"sentry-trace":"4704d54a555a4ce6a25883b8de580de9-58bc3d4df0994711","baggage":"sentry-trace_id=4704d54a555a4ce6a25883b8de580de9,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2a38da1741e30fd64194e24417322400","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:39:53.895Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6cd500f64f61e80fecc57e7c: done: 0.142564 sec","job_status":"done","queue_duration_s":58.23633,"scheduling_latency_s":58.236368,"redis_calls":31,"redis_duration_s":0.007146,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.004306,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001582,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001258,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.070159755,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.142564,"completed_at":"2026-09-04T07:40:52.274Z","load_balancing_strategy":"primary","db_duration_s":0.036083,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 132.426973] bundle[1587]: {"timestamp":"2026-09-04T07:40:53.576Z","pid":1587,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 132.427861] bundle[1587]: {"timestamp":"2026-09-04T07:40:53.576Z","pid":1587,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 132.429265] bundle[1587]: {"timestamp":"2026-09-04T07:40:53.576Z","pid":1587,"message":"! #\u003cThread:0x000076042fa12d78 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 132.430459] bundle[1587]: {"timestamp":"2026-09-04T07:40:53.576Z","pid":1587,"message":"! #\u003cThread:0x000076042fc0bf30 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 132.431852] bundle[1587]: {"timestamp":"2026-09-04T07:40:53.576Z","pid":1587,"message":"Use Ctrl-C to stop"} gitlab # [ 132.459372] bundle[1587]: {"timestamp":"2026-09-04T07:40:53.577Z","pid":1587,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 133.121590] bundle[1587]: {"timestamp":"2026-09-04T07:40:54.271Z","pid":1587,"message":"- Worker 0 (PID: 2175) booted in 0.61s, phase: 0"} gitlab # [ 133.179509] bundle[1587]: {"timestamp":"2026-09-04T07:40:54.329Z","pid":1587,"message":"- Worker 1 (PID: 2179) booted in 0.65s, phase: 0"} gitlab # [ 133.186125] systemd[1]: Started gitlab.service. gitlab # [ 133.189090] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 133.191468] systemd[1]: Starting setup-gitlab.service... gitlab # [ 133.216692] setup-gitlab-start[2203]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 135.511867] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:40:56 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 2265 gitlab # [ 135.516175] setup-gitlab-start[2203]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 135.516921] setup-gitlab-start[2203]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 135.531413] runuser[2225]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 135.920250] setup-gitlab-start[2226]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.920635] setup-gitlab-start[2226]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.922340] setup-gitlab-start[2226]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 136.486584] setup-gitlab-start[2226]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 136.487104] setup-gitlab-start[2226]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 136.488518] setup-gitlab-start[2226]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 144.627539] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:05.776Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4673dd7c3e669b9398cac8f7","created_at":"2026-09-04T07:41:05.751Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.775Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4673dd7c3e669b9398cac8f7: start","job_status":"start","queue_duration_s":0.00096,"scheduling_latency_s":0.000982} gitlab # [ 144.857328] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.007Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4673dd7c3e669b9398cac8f7","created_at":"2026-09-04T07:41:05.751Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.775Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4673dd7c3e669b9398cac8f7: done: 0.230966 sec","job_status":"done","queue_duration_s":0.00096,"scheduling_latency_s":0.000982,"redis_calls":71,"redis_duration_s":0.053341,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.011703,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000797,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.037656,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003185,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000386641,"duration_s":0.230966,"completed_at":"2026-09-04T07:41:06.007Z","load_balancing_strategy":"primary","db_duration_s":0.006875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.925961] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.008Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"01158785dd1f209b206d6632","created_at":"2026-09-04T07:41:05.819Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9074d337de8189a994513a546a66815","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.831Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-01158785dd1f209b206d6632: start","job_status":"start","queue_duration_s":0.176542,"scheduling_latency_s":0.176558} gitlab # [ 144.950915] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.100Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"01158785dd1f209b206d6632","created_at":"2026-09-04T07:41:05.819Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9074d337de8189a994513a546a66815","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.831Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-01158785dd1f209b206d6632: done: 0.092349 sec","job_status":"done","queue_duration_s":0.176542,"scheduling_latency_s":0.176558,"redis_calls":10,"redis_duration_s":0.004047,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002491,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000808762,"duration_s":0.092349,"completed_at":"2026-09-04T07:41:06.100Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.971705] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d05fa28fa94bf3350ea0ef1a","created_at":"2026-09-04T07:41:05.848Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ef7d0e20590b6fc9eeebb23ed6a22b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.893Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d05fa28fa94bf3350ea0ef1a: start","job_status":"start","queue_duration_s":0.21166,"scheduling_latency_s":0.211754} gitlab # [ 145.011368] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.161Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 145.033041] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.182Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d05fa28fa94bf3350ea0ef1a","created_at":"2026-09-04T07:41:05.848Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ef7d0e20590b6fc9eeebb23ed6a22b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.893Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d05fa28fa94bf3350ea0ef1a: done: 0.07741 sec","job_status":"done","queue_duration_s":0.21166,"scheduling_latency_s":0.211754,"redis_calls":10,"redis_duration_s":0.036142,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.032471,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000796191,"duration_s":0.07741,"completed_at":"2026-09-04T07:41:06.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.054573] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c0c0b17443a003ae57d07de8","created_at":"2026-09-04T07:41:05.902Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c32361492d759efd62adeb0734fa5c54","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:41:05.911Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c0c0b17443a003ae57d07de8: start","job_status":"start","queue_duration_s":0.276921,"scheduling_latency_s":0.276957} gitlab # [ 145.142289] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.291Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c0c0b17443a003ae57d07de8","created_at":"2026-09-04T07:41:05.902Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c32361492d759efd62adeb0734fa5c54","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:41:05.911Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c0c0b17443a003ae57d07de8: done: 0.103869 sec","job_status":"done","queue_duration_s":0.276921,"scheduling_latency_s":0.276957,"redis_calls":10,"redis_duration_s":0.04729,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003926,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008347,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.035017,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001608025,"duration_s":0.103869,"completed_at":"2026-09-04T07:41:06.291Z","load_balancing_strategy":"primary","db_duration_s":0.013558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.163865] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3bb5d851e983be45b004b6a0","created_at":"2026-09-04T07:41:05.920Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f356db467bd1c9eff8a39036b958cca","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.929Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3bb5d851e983be45b004b6a0: start","job_status":"start","queue_duration_s":0.376101,"scheduling_latency_s":0.376138} gitlab # [ 145.243632] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.393Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3bb5d851e983be45b004b6a0","created_at":"2026-09-04T07:41:05.920Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f356db467bd1c9eff8a39036b958cca","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.929Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3bb5d851e983be45b004b6a0: done: 0.087432 sec","job_status":"done","queue_duration_s":0.376101,"scheduling_latency_s":0.376138,"redis_calls":12,"redis_duration_s":0.030007000000000002,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.019393,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002376,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001140368,"exclusive_lock_hold_duration_s":0.005144228,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.087432,"completed_at":"2026-09-04T07:41:06.393Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.291449] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"80584add185d5c84f5cbb778","created_at":"2026-09-04T07:41:05.939Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e31184c4c4144485b8d007cdc17fe6b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.949Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-80584add185d5c84f5cbb778: start","job_status":"start","queue_duration_s":0.491635,"scheduling_latency_s":0.491678} gitlab # [ 145.344970] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.494Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"80584add185d5c84f5cbb778","created_at":"2026-09-04T07:41:05.939Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e31184c4c4144485b8d007cdc17fe6b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.949Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-80584add185d5c84f5cbb778: done: 0.053594 sec","job_status":"done","queue_duration_s":0.491635,"scheduling_latency_s":0.491678,"redis_calls":13,"redis_duration_s":0.002859,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001538,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011555659000000001,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.053594,"completed_at":"2026-09-04T07:41:06.494Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002294,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 145.387843] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f035c4743e426fee2cc7fccf","created_at":"2026-09-04T07:41:05.957Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a2710ae49f389e6ad3fd2d035c2e098","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.965Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f035c4743e426fee2cc7fccf: start","job_status":"start","queue_duration_s":0.572229,"scheduling_latency_s":0.572265} gitlab # [ 145.443630] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.592Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f035c4743e426fee2cc7fccf","created_at":"2026-09-04T07:41:05.957Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a2710ae49f389e6ad3fd2d035c2e098","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.965Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f035c4743e426fee2cc7fccf: done: 0.055608 sec","job_status":"done","queue_duration_s":0.572229,"scheduling_latency_s":0.572265,"redis_calls":19,"redis_duration_s":0.00387,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000787,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000337,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001922,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000824,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000331327,"duration_s":0.055608,"completed_at":"2026-09-04T07:41:06.592Z","load_balancing_strategy":"primary","db_duration_s":0.001719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.487163] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.636Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"757962d841bc806fe4da90e4","created_at":"2026-09-04T07:41:05.971Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f41fc9c28e2033a0e66c16a49303c18","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.977Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-757962d841bc806fe4da90e4: start","job_status":"start","queue_duration_s":0.659151,"scheduling_latency_s":0.659204} gitlab # [ 145.800219] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.949Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"757962d841bc806fe4da90e4","created_at":"2026-09-04T07:41:05.971Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f41fc9c28e2033a0e66c16a49303c18","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.977Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-757962d841bc806fe4da90e4: done: 0.312646 sec","job_status":"done","queue_duration_s":0.659151,"scheduling_latency_s":0.659204,"redis_calls":565,"redis_duration_s":0.085024,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.083181,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.243279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276571,"duration_s":0.312646,"completed_at":"2026-09-04T07:41:06.949Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.802100] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:06.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"43dd999b7a89b221440f06e3","created_at":"2026-09-04T07:41:05.981Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abe84b14aa37bc54bd7c9619c339c7c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:41:05.987Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-43dd999b7a89b221440f06e3: start","job_status":"start","queue_duration_s":0.963376,"scheduling_latency_s":0.963391} gitlab # [ 145.870105] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.020Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 145.881437] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"43dd999b7a89b221440f06e3","created_at":"2026-09-04T07:41:05.981Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abe84b14aa37bc54bd7c9619c339c7c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:41:05.987Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-43dd999b7a89b221440f06e3: done: 0.080531 sec","job_status":"done","queue_duration_s":0.963376,"scheduling_latency_s":0.963391,"redis_calls":10,"redis_duration_s":0.003848,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000425,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000404,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000313727,"duration_s":0.080531,"completed_at":"2026-09-04T07:41:07.031Z","load_balancing_strategy":"primary","db_duration_s":0.000561,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.918733] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dc884080767d9189c5e83a4","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dc884080767d9189c5e83a4: start","job_status":"start","queue_duration_s":1.069601,"scheduling_latency_s":1.069622} gitlab # [ 145.963844] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dc884080767d9189c5e83a4","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dc884080767d9189c5e83a4: done: 0.044812 sec","job_status":"done","queue_duration_s":1.069601,"scheduling_latency_s":1.069622,"redis_calls":16,"redis_duration_s":0.005264,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000581,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003067,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000457042,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044812,"completed_at":"2026-09-04T07:41:07.113Z","load_balancing_strategy":"primary","db_duration_s":0.000526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.002530] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f87470b11906a87d1bb41330","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f87470b11906a87d1bb41330: start","job_status":"start","queue_duration_s":1.153163,"scheduling_latency_s":1.153209} gitlab # [ 146.027598] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f87470b11906a87d1bb41330","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f87470b11906a87d1bb41330: done: 0.025151 sec","job_status":"done","queue_duration_s":1.153163,"scheduling_latency_s":1.153209,"redis_calls":13,"redis_duration_s":0.004213,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001717,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002496,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025151,"completed_at":"2026-09-04T07:41:07.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.064110] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13679a67a1e2f21927219b63","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13679a67a1e2f21927219b63: start","job_status":"start","queue_duration_s":1.214333,"scheduling_latency_s":1.214427} gitlab # [ 146.095858] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13679a67a1e2f21927219b63","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13679a67a1e2f21927219b63: done: 0.032075 sec","job_status":"done","queue_duration_s":1.214333,"scheduling_latency_s":1.214427,"redis_calls":13,"redis_duration_s":0.002458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001582,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032075,"completed_at":"2026-09-04T07:41:07.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.131321] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a22ccbdc77450e1bf3f32f0b","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a22ccbdc77450e1bf3f32f0b: start","job_status":"start","queue_duration_s":1.282069,"scheduling_latency_s":1.282109} gitlab # [ 146.155389] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a22ccbdc77450e1bf3f32f0b","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a22ccbdc77450e1bf3f32f0b: done: 0.023998 sec","job_status":"done","queue_duration_s":1.282069,"scheduling_latency_s":1.282109,"redis_calls":13,"redis_duration_s":0.0041010000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023998,"completed_at":"2026-09-04T07:41:07.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.192967] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f102d77cd62b9e69a56718e5","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f102d77cd62b9e69a56718e5: start","job_status":"start","queue_duration_s":1.343622,"scheduling_latency_s":1.343663} gitlab # [ 146.225336] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f102d77cd62b9e69a56718e5","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f102d77cd62b9e69a56718e5: done: 0.032381 sec","job_status":"done","queue_duration_s":1.343622,"scheduling_latency_s":1.343663,"redis_calls":13,"redis_duration_s":0.0040219999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001416,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002606,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032381,"completed_at":"2026-09-04T07:41:07.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.260915] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e90421da1a8a58f6b215ba9b","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e90421da1a8a58f6b215ba9b: start","job_status":"start","queue_duration_s":1.411592,"scheduling_latency_s":1.411638} gitlab # [ 146.285106] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e90421da1a8a58f6b215ba9b","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e90421da1a8a58f6b215ba9b: done: 0.024248 sec","job_status":"done","queue_duration_s":1.411592,"scheduling_latency_s":1.411638,"redis_calls":13,"redis_duration_s":0.003548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002401,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024248,"completed_at":"2026-09-04T07:41:07.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.319626] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f97cd09e6b653f4af49231ea","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f97cd09e6b653f4af49231ea: start","job_status":"start","queue_duration_s":1.470334,"scheduling_latency_s":1.470422} gitlab # [ 146.349976] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f97cd09e6b653f4af49231ea","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f97cd09e6b653f4af49231ea: done: 0.030246 sec","job_status":"done","queue_duration_s":1.470334,"scheduling_latency_s":1.470422,"redis_calls":13,"redis_duration_s":0.002528,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001633,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030246,"completed_at":"2026-09-04T07:41:07.499Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.385317] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a580b82550934bc52c2501e","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a580b82550934bc52c2501e: start","job_status":"start","queue_duration_s":1.535983,"scheduling_latency_s":1.536022} gitlab # [ 146.417669] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a580b82550934bc52c2501e","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a580b82550934bc52c2501e: done: 0.032033 sec","job_status":"done","queue_duration_s":1.535983,"scheduling_latency_s":1.536022,"redis_calls":13,"redis_duration_s":0.0034400000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002412,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032033,"completed_at":"2026-09-04T07:41:07.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.454449] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc1a791de4bbf8f45142f01c","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc1a791de4bbf8f45142f01c: start","job_status":"start","queue_duration_s":1.605071,"scheduling_latency_s":1.605119} gitlab # [ 146.480123] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc1a791de4bbf8f45142f01c","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc1a791de4bbf8f45142f01c: done: 0.025135 sec","job_status":"done","queue_duration_s":1.605071,"scheduling_latency_s":1.605119,"redis_calls":13,"redis_duration_s":0.003714,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002509,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025135,"completed_at":"2026-09-04T07:41:07.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.515152] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9419558e0be70153615a8be0","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9419558e0be70153615a8be0: start","job_status":"start","queue_duration_s":1.665942,"scheduling_latency_s":1.66598} gitlab # [ 146.548558] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9419558e0be70153615a8be0","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9419558e0be70153615a8be0: done: 0.03297 sec","job_status":"done","queue_duration_s":1.665942,"scheduling_latency_s":1.66598,"redis_calls":13,"redis_duration_s":0.00393,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001367,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002563,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015647,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03297,"completed_at":"2026-09-04T07:41:07.697Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.584468] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"342cc6f90df0c6415d05e682","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-342cc6f90df0c6415d05e682: start","job_status":"start","queue_duration_s":1.735117,"scheduling_latency_s":1.735155} gitlab # [ 146.608141] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"342cc6f90df0c6415d05e682","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-342cc6f90df0c6415d05e682: done: 0.023787 sec","job_status":"done","queue_duration_s":1.735117,"scheduling_latency_s":1.735155,"redis_calls":13,"redis_duration_s":0.004202,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023787,"completed_at":"2026-09-04T07:41:07.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.644916] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d24da17ac2bf3e153561c6a","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d24da17ac2bf3e153561c6a: start","job_status":"start","queue_duration_s":1.795644,"scheduling_latency_s":1.795685} gitlab # [ 146.668706] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d24da17ac2bf3e153561c6a","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d24da17ac2bf3e153561c6a: done: 0.023746 sec","job_status":"done","queue_duration_s":1.795644,"scheduling_latency_s":1.795685,"redis_calls":13,"redis_duration_s":0.0036569999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002398,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023746,"completed_at":"2026-09-04T07:41:07.818Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.705281] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32b700c7f545efad86b862b4","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32b700c7f545efad86b862b4: start","job_status":"start","queue_duration_s":1.855652,"scheduling_latency_s":1.855699} gitlab # [ 146.730186] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32b700c7f545efad86b862b4","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32b700c7f545efad86b862b4: done: 0.025431 sec","job_status":"done","queue_duration_s":1.855652,"scheduling_latency_s":1.855699,"redis_calls":13,"redis_duration_s":0.004282,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025431,"completed_at":"2026-09-04T07:41:07.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.752243] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d51f0225ba2d4f266eabfae5","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d51f0225ba2d4f266eabfae5: start","job_status":"start","queue_duration_s":1.882982,"scheduling_latency_s":1.883018} gitlab # [ 146.754880] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d51f0225ba2d4f266eabfae5","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d51f0225ba2d4f266eabfae5: done: 0.02277 sec","job_status":"done","queue_duration_s":1.882982,"scheduling_latency_s":1.883018,"redis_calls":13,"redis_duration_s":0.003134,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02277,"completed_at":"2026-09-04T07:41:07.904Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.798314] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bb274c953876db864256054","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bb274c953876db864256054: start","job_status":"start","queue_duration_s":1.90751,"scheduling_latency_s":1.907536} gitlab # [ 146.799200] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bb274c953876db864256054","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bb274c953876db864256054: done: 0.014216 sec","job_status":"done","queue_duration_s":1.90751,"scheduling_latency_s":1.907536,"redis_calls":13,"redis_duration_s":0.002441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001601,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014216,"completed_at":"2026-09-04T07:41:07.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.824819] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cfcdfc7c482faec31266449","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cfcdfc7c482faec31266449: start","job_status":"start","queue_duration_s":1.922755,"scheduling_latency_s":1.92277} gitlab # [ 146.836749] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cfcdfc7c482faec31266449","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cfcdfc7c482faec31266449: done: 0.010727 sec","job_status":"done","queue_duration_s":1.922755,"scheduling_latency_s":1.92277,"redis_calls":13,"redis_duration_s":0.002255,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001575,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010727,"completed_at":"2026-09-04T07:41:07.932Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.881729] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faf5432da7fe8539cd0f3f49","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faf5432da7fe8539cd0f3f49: start","job_status":"start","queue_duration_s":1.934454,"scheduling_latency_s":1.934469} gitlab # [ 146.926670] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faf5432da7fe8539cd0f3f49","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faf5432da7fe8539cd0f3f49: done: 0.010376 sec","job_status":"done","queue_duration_s":1.934454,"scheduling_latency_s":1.934469,"redis_calls":13,"redis_duration_s":0.002387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010376,"completed_at":"2026-09-04T07:41:07.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.927699] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96274d3f9eaee786696a3de6","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96274d3f9eaee786696a3de6: start","job_status":"start","queue_duration_s":1.945823,"scheduling_latency_s":1.945836} gitlab # [ 146.971837] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96274d3f9eaee786696a3de6","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96274d3f9eaee786696a3de6: done: 0.009964 sec","job_status":"done","queue_duration_s":1.945823,"scheduling_latency_s":1.945836,"redis_calls":13,"redis_duration_s":0.001839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001288,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009964,"completed_at":"2026-09-04T07:41:07.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.973084] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d6eb96e8fc51f5d0e161ac4","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d6eb96e8fc51f5d0e161ac4: start","job_status":"start","queue_duration_s":1.956808,"scheduling_latency_s":1.956821} gitlab # [ 147.023896] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d6eb96e8fc51f5d0e161ac4","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d6eb96e8fc51f5d0e161ac4: done: 0.009864 sec","job_status":"done","queue_duration_s":1.956808,"scheduling_latency_s":1.956821,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009864,"completed_at":"2026-09-04T07:41:07.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.024990] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fc699e6b72de4a892566450","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fc699e6b72de4a892566450: start","job_status":"start","queue_duration_s":1.967743,"scheduling_latency_s":1.967757} gitlab # [ 147.069152] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fc699e6b72de4a892566450","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fc699e6b72de4a892566450: done: 0.009843 sec","job_status":"done","queue_duration_s":1.967743,"scheduling_latency_s":1.967757,"redis_calls":13,"redis_duration_s":0.00179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009843,"completed_at":"2026-09-04T07:41:07.976Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.070637] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5713ce3d9fbef25f33228870","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5713ce3d9fbef25f33228870: start","job_status":"start","queue_duration_s":1.978746,"scheduling_latency_s":1.97876} gitlab # [ 147.121292] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5713ce3d9fbef25f33228870","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5713ce3d9fbef25f33228870: done: 0.009991 sec","job_status":"done","queue_duration_s":1.978746,"scheduling_latency_s":1.97876,"redis_calls":13,"redis_duration_s":0.0016939999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009991,"completed_at":"2026-09-04T07:41:07.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.122877] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae66c02709282b8c48edb9c2","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae66c02709282b8c48edb9c2: start","job_status":"start","queue_duration_s":1.989784,"scheduling_latency_s":1.989798} gitlab # [ 147.167927] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae66c02709282b8c48edb9c2","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae66c02709282b8c48edb9c2: done: 0.009909 sec","job_status":"done","queue_duration_s":1.989784,"scheduling_latency_s":1.989798,"redis_calls":13,"redis_duration_s":0.001689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009909,"completed_at":"2026-09-04T07:41:07.998Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.169731] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:07.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6925e442a2bec568877f2fd7","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6925e442a2bec568877f2fd7: start","job_status":"start","queue_duration_s":2.000761,"scheduling_latency_s":2.000775} gitlab # [ 147.216879] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6925e442a2bec568877f2fd7","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6925e442a2bec568877f2fd7: done: 0.009851 sec","job_status":"done","queue_duration_s":2.000761,"scheduling_latency_s":2.000775,"redis_calls":13,"redis_duration_s":0.001639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009851,"completed_at":"2026-09-04T07:41:08.009Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.218362] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c90e17790875a174916ada4","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c90e17790875a174916ada4: start","job_status":"start","queue_duration_s":2.011479,"scheduling_latency_s":2.011493} gitlab # [ 147.264299] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c90e17790875a174916ada4","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c90e17790875a174916ada4: done: 0.009831 sec","job_status":"done","queue_duration_s":2.011479,"scheduling_latency_s":2.011493,"redis_calls":13,"redis_duration_s":0.0016910000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009831,"completed_at":"2026-09-04T07:41:08.020Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.265747] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40bf2f7d94a4f09b92eae4ab","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40bf2f7d94a4f09b92eae4ab: start","job_status":"start","queue_duration_s":2.02217,"scheduling_latency_s":2.022184} gitlab # [ 147.311282] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40bf2f7d94a4f09b92eae4ab","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40bf2f7d94a4f09b92eae4ab: done: 0.009878 sec","job_status":"done","queue_duration_s":2.02217,"scheduling_latency_s":2.022184,"redis_calls":13,"redis_duration_s":0.001823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001279,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009878,"completed_at":"2026-09-04T07:41:08.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.312864] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e69f48c8e8b564b4981fa2d7","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e69f48c8e8b564b4981fa2d7: start","job_status":"start","queue_duration_s":2.032914,"scheduling_latency_s":2.032928} gitlab # [ 147.353531] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e69f48c8e8b564b4981fa2d7","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e69f48c8e8b564b4981fa2d7: done: 0.009936 sec","job_status":"done","queue_duration_s":2.032914,"scheduling_latency_s":2.032928,"redis_calls":13,"redis_duration_s":0.0016480000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009936,"completed_at":"2026-09-04T07:41:08.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.357897] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7a9b85dd2fedceb1ab72d53","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7a9b85dd2fedceb1ab72d53: start","job_status":"start","queue_duration_s":2.0437,"scheduling_latency_s":2.043714} gitlab # [ 147.370232] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7a9b85dd2fedceb1ab72d53","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7a9b85dd2fedceb1ab72d53: done: 0.009966 sec","job_status":"done","queue_duration_s":2.0437,"scheduling_latency_s":2.043714,"redis_calls":13,"redis_duration_s":0.001752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009966,"completed_at":"2026-09-04T07:41:08.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.408764] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c8a025a43068bd44373d180","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c8a025a43068bd44373d180: start","job_status":"start","queue_duration_s":2.054739,"scheduling_latency_s":2.054753} gitlab # [ 147.453758] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c8a025a43068bd44373d180","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c8a025a43068bd44373d180: done: 0.009814 sec","job_status":"done","queue_duration_s":2.054739,"scheduling_latency_s":2.054753,"redis_calls":13,"redis_duration_s":0.001703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009814,"completed_at":"2026-09-04T07:41:08.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.457738] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea0049b10a15b6f4b89e9fd3","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea0049b10a15b6f4b89e9fd3: start","job_status":"start","queue_duration_s":2.065535,"scheduling_latency_s":2.065549} gitlab # [ 147.503442] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea0049b10a15b6f4b89e9fd3","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea0049b10a15b6f4b89e9fd3: done: 0.009888 sec","job_status":"done","queue_duration_s":2.065535,"scheduling_latency_s":2.065549,"redis_calls":13,"redis_duration_s":0.001671,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009888,"completed_at":"2026-09-04T07:41:08.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.504700] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2a7283015aa676724dc1e60","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2a7283015aa676724dc1e60: start","job_status":"start","queue_duration_s":2.07642,"scheduling_latency_s":2.076435} gitlab # [ 147.548863] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2a7283015aa676724dc1e60","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2a7283015aa676724dc1e60: done: 0.013509 sec","job_status":"done","queue_duration_s":2.07642,"scheduling_latency_s":2.076435,"redis_calls":13,"redis_duration_s":0.001959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001327,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013509,"completed_at":"2026-09-04T07:41:08.088Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.551424] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cd261d3f8e1236e45fd7790","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cd261d3f8e1236e45fd7790: start","job_status":"start","queue_duration_s":2.090852,"scheduling_latency_s":2.090867} gitlab # [ 147.601767] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cd261d3f8e1236e45fd7790","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cd261d3f8e1236e45fd7790: done: 0.009771 sec","job_status":"done","queue_duration_s":2.090852,"scheduling_latency_s":2.090867,"redis_calls":13,"redis_duration_s":0.001692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009771,"completed_at":"2026-09-04T07:41:08.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.603055] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecf6814a17d124adb3d058bc","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecf6814a17d124adb3d058bc: start","job_status":"start","queue_duration_s":2.101653,"scheduling_latency_s":2.101667} gitlab # [ 147.644742] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecf6814a17d124adb3d058bc","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecf6814a17d124adb3d058bc: done: 0.009832 sec","job_status":"done","queue_duration_s":2.101653,"scheduling_latency_s":2.101667,"redis_calls":13,"redis_duration_s":0.0016749999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009832,"completed_at":"2026-09-04T07:41:08.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.646747] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c999655fe1f625ce3b68503e","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c999655fe1f625ce3b68503e: start","job_status":"start","queue_duration_s":2.112522,"scheduling_latency_s":2.112537} gitlab # [ 147.658619] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c999655fe1f625ce3b68503e","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c999655fe1f625ce3b68503e: done: 0.009671 sec","job_status":"done","queue_duration_s":2.112522,"scheduling_latency_s":2.112537,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009671,"completed_at":"2026-09-04T07:41:08.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.697713] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e96bc9a21041320de917912e","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e96bc9a21041320de917912e: start","job_status":"start","queue_duration_s":2.123194,"scheduling_latency_s":2.123208} gitlab # [ 147.703927] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e96bc9a21041320de917912e","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e96bc9a21041320de917912e: done: 0.009903 sec","job_status":"done","queue_duration_s":2.123194,"scheduling_latency_s":2.123208,"redis_calls":13,"redis_duration_s":0.001692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009903,"completed_at":"2026-09-04T07:41:08.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.744309] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"384c2ec38cd689b9ee6613f6","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-384c2ec38cd689b9ee6613f6: start","job_status":"start","queue_duration_s":2.134163,"scheduling_latency_s":2.134177} gitlab # [ 147.750820] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"384c2ec38cd689b9ee6613f6","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-384c2ec38cd689b9ee6613f6: done: 0.009872 sec","job_status":"done","queue_duration_s":2.134163,"scheduling_latency_s":2.134177,"redis_calls":13,"redis_duration_s":0.001707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009872,"completed_at":"2026-09-04T07:41:08.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.796768] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc59d3759eea9626460c6084","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc59d3759eea9626460c6084: start","job_status":"start","queue_duration_s":2.145196,"scheduling_latency_s":2.14521} gitlab # [ 147.797622] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc59d3759eea9626460c6084","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc59d3759eea9626460c6084: done: 0.009999 sec","job_status":"done","queue_duration_s":2.145196,"scheduling_latency_s":2.14521,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009999,"completed_at":"2026-09-04T07:41:08.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.855128] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b4ef09a064776b1dbe83dab","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b4ef09a064776b1dbe83dab: start","job_status":"start","queue_duration_s":2.156064,"scheduling_latency_s":2.156079} gitlab # [ 147.855842] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b4ef09a064776b1dbe83dab","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b4ef09a064776b1dbe83dab: done: 0.010041 sec","job_status":"done","queue_duration_s":2.156064,"scheduling_latency_s":2.156079,"redis_calls":13,"redis_duration_s":0.001673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010041,"completed_at":"2026-09-04T07:41:08.165Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.897486] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d47e7362bf111ef2783bf728","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d47e7362bf111ef2783bf728: start","job_status":"start","queue_duration_s":2.166976,"scheduling_latency_s":2.166991} gitlab # [ 147.898102] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d47e7362bf111ef2783bf728","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d47e7362bf111ef2783bf728: done: 0.009841 sec","job_status":"done","queue_duration_s":2.166976,"scheduling_latency_s":2.166991,"redis_calls":13,"redis_duration_s":0.0017259999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009841,"completed_at":"2026-09-04T07:41:08.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.946458] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b8315f2235cda1b4d19fd95","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b8315f2235cda1b4d19fd95: start","job_status":"start","queue_duration_s":2.177713,"scheduling_latency_s":2.177736} gitlab # [ 147.947232] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b8315f2235cda1b4d19fd95","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b8315f2235cda1b4d19fd95: done: 0.010078 sec","job_status":"done","queue_duration_s":2.177713,"scheduling_latency_s":2.177736,"redis_calls":13,"redis_duration_s":0.00183,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010078,"completed_at":"2026-09-04T07:41:08.186Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.992596] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a08d92bf5329dea5f158178","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a08d92bf5329dea5f158178: start","job_status":"start","queue_duration_s":2.188636,"scheduling_latency_s":2.18865} gitlab # [ 147.993522] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a08d92bf5329dea5f158178","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a08d92bf5329dea5f158178: done: 0.009841 sec","job_status":"done","queue_duration_s":2.188636,"scheduling_latency_s":2.18865,"redis_calls":13,"redis_duration_s":0.001634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009841,"completed_at":"2026-09-04T07:41:08.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.045896] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed9c727d4db911ccf4bb3903","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed9c727d4db911ccf4bb3903: start","job_status":"start","queue_duration_s":2.19931,"scheduling_latency_s":2.199323} gitlab # [ 148.046607] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed9c727d4db911ccf4bb3903","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed9c727d4db911ccf4bb3903: done: 0.00961 sec","job_status":"done","queue_duration_s":2.19931,"scheduling_latency_s":2.199323,"redis_calls":13,"redis_duration_s":0.0016589999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00961,"completed_at":"2026-09-04T07:41:08.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.062502] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9b59d3c7dd62418d7202c9d","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9b59d3c7dd62418d7202c9d: start","job_status":"start","queue_duration_s":2.209925,"scheduling_latency_s":2.209938} gitlab # [ 148.073415] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9b59d3c7dd62418d7202c9d","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9b59d3c7dd62418d7202c9d: done: 0.009946 sec","job_status":"done","queue_duration_s":2.209925,"scheduling_latency_s":2.209938,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009946,"completed_at":"2026-09-04T07:41:08.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.131030] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2b9ff197f13f547eb917b68","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2b9ff197f13f547eb917b68: start","job_status":"start","queue_duration_s":2.220901,"scheduling_latency_s":2.220915} gitlab # [ 148.131764] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2b9ff197f13f547eb917b68","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2b9ff197f13f547eb917b68: done: 0.00974 sec","job_status":"done","queue_duration_s":2.220901,"scheduling_latency_s":2.220915,"redis_calls":13,"redis_duration_s":0.001648,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00974,"completed_at":"2026-09-04T07:41:08.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.175517] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be92e1904e31408e1f2734d0","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be92e1904e31408e1f2734d0: start","job_status":"start","queue_duration_s":2.23168,"scheduling_latency_s":2.231693} gitlab # [ 148.176270] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be92e1904e31408e1f2734d0","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be92e1904e31408e1f2734d0: done: 0.009669 sec","job_status":"done","queue_duration_s":2.23168,"scheduling_latency_s":2.231693,"redis_calls":13,"redis_duration_s":0.001637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009669,"completed_at":"2026-09-04T07:41:08.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.217460] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f387df7a561e8466950876f","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f387df7a561e8466950876f: start","job_status":"start","queue_duration_s":2.242388,"scheduling_latency_s":2.242402} gitlab # [ 148.218281] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f387df7a561e8466950876f","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f387df7a561e8466950876f: done: 0.009921 sec","job_status":"done","queue_duration_s":2.242388,"scheduling_latency_s":2.242402,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009921,"completed_at":"2026-09-04T07:41:08.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.273262] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3afd01fe4b57aa8f333b4442","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3afd01fe4b57aa8f333b4442: start","job_status":"start","queue_duration_s":2.253335,"scheduling_latency_s":2.253376} gitlab # [ 148.274023] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3afd01fe4b57aa8f333b4442","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3afd01fe4b57aa8f333b4442: done: 0.010146 sec","job_status":"done","queue_duration_s":2.253335,"scheduling_latency_s":2.253376,"redis_calls":13,"redis_duration_s":0.001756,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010146,"completed_at":"2026-09-04T07:41:08.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.323992] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da0c94dd59a7888e4bc7a76a","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da0c94dd59a7888e4bc7a76a: start","job_status":"start","queue_duration_s":2.264307,"scheduling_latency_s":2.264321} gitlab # [ 148.324822] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da0c94dd59a7888e4bc7a76a","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da0c94dd59a7888e4bc7a76a: done: 0.009924 sec","job_status":"done","queue_duration_s":2.264307,"scheduling_latency_s":2.264321,"redis_calls":13,"redis_duration_s":0.001794,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009924,"completed_at":"2026-09-04T07:41:08.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.370245] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c83fbccde91044cdf3ce3174","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c83fbccde91044cdf3ce3174: start","job_status":"start","queue_duration_s":2.275102,"scheduling_latency_s":2.275115} gitlab # [ 148.371022] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c83fbccde91044cdf3ce3174","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c83fbccde91044cdf3ce3174: done: 0.00972 sec","job_status":"done","queue_duration_s":2.275102,"scheduling_latency_s":2.275115,"redis_calls":13,"redis_duration_s":0.0016909999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00972,"completed_at":"2026-09-04T07:41:08.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.423073] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3b1f53f541d5eb2e531c99a","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3b1f53f541d5eb2e531c99a: start","job_status":"start","queue_duration_s":2.285839,"scheduling_latency_s":2.285852} gitlab # [ 148.423631] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3b1f53f541d5eb2e531c99a","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3b1f53f541d5eb2e531c99a: done: 0.009812 sec","job_status":"done","queue_duration_s":2.285839,"scheduling_latency_s":2.285852,"redis_calls":13,"redis_duration_s":0.0016179999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009812,"completed_at":"2026-09-04T07:41:08.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.462585] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"677f017989db8348c73187e9","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-677f017989db8348c73187e9: start","job_status":"start","queue_duration_s":2.296529,"scheduling_latency_s":2.296543} gitlab # [ 148.463247] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"677f017989db8348c73187e9","created_at":"2026-09-04T07:41:05.863Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-39d6c0fb4da0496f","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"00ae4cc41256a9c139866d3dfe50eb4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:05.998Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-677f017989db8348c73187e9: done: 0.009919 sec","job_status":"done","queue_duration_s":2.296529,"scheduling_latency_s":2.296543,"redis_calls":13,"redis_duration_s":0.001755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009919,"completed_at":"2026-09-04T07:41:08.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.515183] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.306Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c984ddd7422fe0a18722bc1b","created_at":"2026-09-04T07:41:05.996Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19daaf04c44cc7398b9501b18f4f1281","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.002Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c984ddd7422fe0a18722bc1b: start","job_status":"start","queue_duration_s":2.303446,"scheduling_latency_s":2.303459} gitlab # [ 148.515704] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.340Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c984ddd7422fe0a18722bc1b","created_at":"2026-09-04T07:41:05.996Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19daaf04c44cc7398b9501b18f4f1281","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.002Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c984ddd7422fe0a18722bc1b: done: 0.034592 sec","job_status":"done","queue_duration_s":2.303446,"scheduling_latency_s":2.303459,"redis_calls":10,"redis_duration_s":0.0016350000000000002,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000313,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000255619,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.034592,"completed_at":"2026-09-04T07:41:08.340Z","load_balancing_strategy":"primary","db_duration_s":0.019424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.563031] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.341Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7b8015cab429646aa205f423","created_at":"2026-09-04T07:41:06.021Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"151831cddbf5d394ac234348f12ebad3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.054Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7b8015cab429646aa205f423: start","job_status":"start","queue_duration_s":2.286997,"scheduling_latency_s":2.287012} gitlab # [ 148.563873] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7b8015cab429646aa205f423","created_at":"2026-09-04T07:41:06.021Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"151831cddbf5d394ac234348f12ebad3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.054Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7b8015cab429646aa205f423: done: 0.05498 sec","job_status":"done","queue_duration_s":2.286997,"scheduling_latency_s":2.287012,"redis_calls":12,"redis_duration_s":0.00184,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000703,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000410108,"exclusive_lock_hold_duration_s":0.028263089,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.05498,"completed_at":"2026-09-04T07:41:08.396Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.612994] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"bc8e34fec279fffe7c0588c0","created_at":"2026-09-04T07:41:06.063Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdde0477fe0684d701b5a842e7607fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.081Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-bc8e34fec279fffe7c0588c0: start","job_status":"start","queue_duration_s":2.316818,"scheduling_latency_s":2.316832} gitlab # [ 148.613803] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.435Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"bc8e34fec279fffe7c0588c0","created_at":"2026-09-04T07:41:06.063Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdde0477fe0684d701b5a842e7607fe8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.081Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-bc8e34fec279fffe7c0588c0: done: 0.037934 sec","job_status":"done","queue_duration_s":2.316818,"scheduling_latency_s":2.316832,"redis_calls":14,"redis_duration_s":0.00218,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000555,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000635,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000328254,"exclusive_lock_hold_duration_s":0.023051532,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.037934,"completed_at":"2026-09-04T07:41:08.435Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01773,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.664091] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1aebbc3c7d8d31b71d8ef41c","created_at":"2026-09-04T07:41:06.092Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf607769152dbb9ee25ff3cf9ed30460","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.102Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1aebbc3c7d8d31b71d8ef41c: start","job_status":"start","queue_duration_s":2.334226,"scheduling_latency_s":2.334239} gitlab # [ 148.664649] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1aebbc3c7d8d31b71d8ef41c","created_at":"2026-09-04T07:41:06.092Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf607769152dbb9ee25ff3cf9ed30460","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.102Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1aebbc3c7d8d31b71d8ef41c: done: 0.060415 sec","job_status":"done","queue_duration_s":2.334226,"scheduling_latency_s":2.334239,"redis_calls":12,"redis_duration_s":0.001692,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000603,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212597,"duration_s":0.060415,"completed_at":"2026-09-04T07:41:08.497Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000807,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.706643] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.498Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b3dc2bfe7e1e47224b545667","created_at":"2026-09-04T07:41:06.111Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f4cd37f426fa22bc0c44d1473ad13cb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.163Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b3dc2bfe7e1e47224b545667: start","job_status":"start","queue_duration_s":2.335642,"scheduling_latency_s":2.33566} gitlab # [ 148.707262] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.525Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b3dc2bfe7e1e47224b545667","created_at":"2026-09-04T07:41:06.111Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f4cd37f426fa22bc0c44d1473ad13cb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.163Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b3dc2bfe7e1e47224b545667: done: 0.026932 sec","job_status":"done","queue_duration_s":2.335642,"scheduling_latency_s":2.33566,"redis_calls":16,"redis_duration_s":0.002255,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001069,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000250032,"duration_s":0.026932,"completed_at":"2026-09-04T07:41:08.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.750848] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.526Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d776a1e58d1177ad2a233f9d","created_at":"2026-09-04T07:41:06.177Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"daee191bff5c14edcb0c38aaab2cc594","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:41:06.186Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d776a1e58d1177ad2a233f9d: start","job_status":"start","queue_duration_s":2.339716,"scheduling_latency_s":2.33973} gitlab # [ 148.751642] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.534Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 148.752567] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d776a1e58d1177ad2a233f9d","created_at":"2026-09-04T07:41:06.177Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"daee191bff5c14edcb0c38aaab2cc594","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:41:06.186Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d776a1e58d1177ad2a233f9d: done: 0.011729 sec","job_status":"done","queue_duration_s":2.339716,"scheduling_latency_s":2.33973,"redis_calls":10,"redis_duration_s":0.00133,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000769,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209244,"duration_s":0.011729,"completed_at":"2026-09-04T07:41:08.538Z","load_balancing_strategy":"primary","db_duration_s":0.001129,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.790215] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4eee301d6a6ebe5afb5267df","created_at":"2026-09-04T07:41:06.233Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b73a2a1508d786b7f5784d3e103cec1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.248Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4eee301d6a6ebe5afb5267df: start","job_status":"start","queue_duration_s":2.290297,"scheduling_latency_s":2.29031} gitlab # [ 148.803487] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.546Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 148.806722] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.552Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4eee301d6a6ebe5afb5267df","created_at":"2026-09-04T07:41:06.233Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b73a2a1508d786b7f5784d3e103cec1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.248Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4eee301d6a6ebe5afb5267df: done: 0.012963 sec","job_status":"done","queue_duration_s":2.290297,"scheduling_latency_s":2.29031,"redis_calls":10,"redis_duration_s":0.001401,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238577,"duration_s":0.012963,"completed_at":"2026-09-04T07:41:08.552Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.861051] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.553Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2f3e26711b67199c0dd03fe3","created_at":"2026-09-04T07:41:06.267Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2d9eccfb3169a8f42c6d30dbc9c1d3e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.283Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2f3e26711b67199c0dd03fe3: start","job_status":"start","queue_duration_s":2.269795,"scheduling_latency_s":2.269808} gitlab # [ 148.861823] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2f3e26711b67199c0dd03fe3","created_at":"2026-09-04T07:41:06.267Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2d9eccfb3169a8f42c6d30dbc9c1d3e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.283Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2f3e26711b67199c0dd03fe3: done: 0.016491 sec","job_status":"done","queue_duration_s":2.269795,"scheduling_latency_s":2.269808,"redis_calls":12,"redis_duration_s":0.001907,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000808,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000318197,"exclusive_lock_hold_duration_s":0.005097575,"duration_s":0.016491,"completed_at":"2026-09-04T07:41:08.569Z","load_balancing_strategy":"primary","db_duration_s":0.002775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.927104] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"18512177f68df45b6f2e1522","created_at":"2026-09-04T07:41:06.299Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d94ca8f059fe5e7488cdf11bb712830","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.310Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-18512177f68df45b6f2e1522: start","job_status":"start","queue_duration_s":2.260392,"scheduling_latency_s":2.260406} gitlab # [ 148.927773] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.577Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 148.928451] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"18512177f68df45b6f2e1522","created_at":"2026-09-04T07:41:06.299Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d94ca8f059fe5e7488cdf11bb712830","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.310Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-18512177f68df45b6f2e1522: done: 0.010814 sec","job_status":"done","queue_duration_s":2.260392,"scheduling_latency_s":2.260406,"redis_calls":10,"redis_duration_s":0.001423,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000356,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212596,"duration_s":0.010814,"completed_at":"2026-09-04T07:41:08.581Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.948587] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7996273e3ee2bd864d9581ba","created_at":"2026-09-04T07:41:06.317Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e9624a88d12ab6f968c1107164c94c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.324Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7996273e3ee2bd864d9581ba: start","job_status":"start","queue_duration_s":2.257509,"scheduling_latency_s":2.257524} gitlab # [ 148.996957] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7996273e3ee2bd864d9581ba","created_at":"2026-09-04T07:41:06.317Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e9624a88d12ab6f968c1107164c94c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.324Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7996273e3ee2bd864d9581ba: done: 0.139444 sec","job_status":"done","queue_duration_s":2.257509,"scheduling_latency_s":2.257524,"redis_calls":12,"redis_duration_s":0.001986,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000354514,"exclusive_lock_hold_duration_s":0.123685831,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.139444,"completed_at":"2026-09-04T07:41:08.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.037695] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5849f0d125dcad15ed01c22b","created_at":"2026-09-04T07:41:06.328Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe63aa6e27efa4e6a092e135bc528dec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.342Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5849f0d125dcad15ed01c22b: start","job_status":"start","queue_duration_s":2.380582,"scheduling_latency_s":2.380598} gitlab # [ 149.038453] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.730Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 149.038923] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5849f0d125dcad15ed01c22b","created_at":"2026-09-04T07:41:06.328Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe63aa6e27efa4e6a092e135bc528dec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.342Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5849f0d125dcad15ed01c22b: done: 0.012353 sec","job_status":"done","queue_duration_s":2.380582,"scheduling_latency_s":2.380598,"redis_calls":10,"redis_duration_s":0.001464,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000394,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196952,"duration_s":0.012353,"completed_at":"2026-09-04T07:41:08.735Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.054033] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4d963270645a723cdc264daa","created_at":"2026-09-04T07:41:06.371Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb2a869cf0e81597bba6db2138f0bf4d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.381Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4d963270645a723cdc264daa: start","job_status":"start","queue_duration_s":2.354264,"scheduling_latency_s":2.354277} gitlab # [ 149.066970] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.747Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4d963270645a723cdc264daa","created_at":"2026-09-04T07:41:06.371Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-83b7f3d34ac64bda","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb2a869cf0e81597bba6db2138f0bf4d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.381Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4d963270645a723cdc264daa: done: 0.011679 sec","job_status":"done","queue_duration_s":2.354264,"scheduling_latency_s":2.354277,"redis_calls":10,"redis_duration_s":0.001583,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000638,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197511,"duration_s":0.011679,"completed_at":"2026-09-04T07:41:08.747Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.118040] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.748Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"05d99f899e8b90248174f8a6","created_at":"2026-09-04T07:41:06.568Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-ef809a260aca4dce","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a2710ae49f389e6ad3fd2d035c2e098","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.583Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-05d99f899e8b90248174f8a6: start","job_status":"start","queue_duration_s":2.164537,"scheduling_latency_s":2.164551} gitlab # [ 149.118806] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.759Z","message":"No existing merge request to be cleaned up."} gitlab # [ 149.119587] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.768Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"05d99f899e8b90248174f8a6","created_at":"2026-09-04T07:41:06.568Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-ef809a260aca4dce","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a2710ae49f389e6ad3fd2d035c2e098","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.583Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-05d99f899e8b90248174f8a6: done: 0.019912 sec","job_status":"done","queue_duration_s":2.164537,"scheduling_latency_s":2.164551,"redis_calls":13,"redis_duration_s":0.001809,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223213,"duration_s":0.019912,"completed_at":"2026-09-04T07:41:08.768Z","load_balancing_strategy":"primary","db_duration_s":0.003945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.159719] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.769Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"569153d8dfff450ec49dbbb9","created_at":"2026-09-04T07:41:06.568Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-ef809a260aca4dce","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a2710ae49f389e6ad3fd2d035c2e098","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.583Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-569153d8dfff450ec49dbbb9: start","job_status":"start","queue_duration_s":2.185273,"scheduling_latency_s":2.185286} gitlab # [ 149.199508] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.775Z","message":"No existing merge request to be cleaned up."} gitlab # [ 149.200261] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.779Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"569153d8dfff450ec49dbbb9","created_at":"2026-09-04T07:41:06.568Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-ef809a260aca4dce","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a2710ae49f389e6ad3fd2d035c2e098","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.583Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-569153d8dfff450ec49dbbb9: done: 0.010519 sec","job_status":"done","queue_duration_s":2.185273,"scheduling_latency_s":2.185286,"redis_calls":10,"redis_duration_s":0.001294,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000738,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010519,"completed_at":"2026-09-04T07:41:08.779Z","load_balancing_strategy":"primary","db_duration_s":0.000982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.201209] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.780Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"efbdd0734e741bfb17f1dfa9","created_at":"2026-09-04T07:41:06.568Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-ef809a260aca4dce","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a2710ae49f389e6ad3fd2d035c2e098","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.583Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-efbdd0734e741bfb17f1dfa9: start","job_status":"start","queue_duration_s":2.196599,"scheduling_latency_s":2.196612} gitlab # [ 149.212392] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.786Z","message":"No existing merge request to be cleaned up."} gitlab # [ 149.214074] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.791Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"efbdd0734e741bfb17f1dfa9","created_at":"2026-09-04T07:41:06.568Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-ef809a260aca4dce","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a2710ae49f389e6ad3fd2d035c2e098","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.583Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-efbdd0734e741bfb17f1dfa9: done: 0.01117 sec","job_status":"done","queue_duration_s":2.196599,"scheduling_latency_s":2.196612,"redis_calls":10,"redis_duration_s":0.0012369999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01117,"completed_at":"2026-09-04T07:41:08.791Z","load_balancing_strategy":"primary","db_duration_s":0.000939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.281659] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.792Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b1112d12a3139291e2d6b90c","created_at":"2026-09-04T07:41:06.568Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-ef809a260aca4dce","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a2710ae49f389e6ad3fd2d035c2e098","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.583Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b1112d12a3139291e2d6b90c: start","job_status":"start","queue_duration_s":2.208602,"scheduling_latency_s":2.208615} gitlab # [ 149.282380] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.798Z","message":"No existing merge request to be cleaned up."} gitlab # [ 149.282950] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:08.803Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b1112d12a3139291e2d6b90c","created_at":"2026-09-04T07:41:06.568Z","trace_propagation_headers":{"sentry-trace":"974983451c504ce19ecc95dc03bf8c0b-ef809a260aca4dce","baggage":"sentry-trace_id=974983451c504ce19ecc95dc03bf8c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a2710ae49f389e6ad3fd2d035c2e098","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:06.583Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"madh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b1112d12a3139291e2d6b90c: done: 0.011073 sec","job_status":"done","queue_duration_s":2.208602,"scheduling_latency_s":2.208615,"redis_calls":10,"redis_duration_s":0.001242,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000726,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011073,"completed_at":"2026-09-04T07:41:08.803Z","load_balancing_strategy":"primary","db_duration_s":0.001375,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.482625] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 3075355038 wd_nsec: 3075354733 gitlab # [ 161.676585] setup-gitlab-start[2226]: W, [2026-09-04T07:41:22.825941 #2226] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 182.834673] postgres[2426]: [2426] ERROR: relation "table_without_models" does not exist gitlab # [ 182.837667] postgres[2426]: [2426] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 186.222097] runuser[2225]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 186.225606] setup-gitlab-start[2203]: + systemctl restart gitlab-sidekiq.service gitlab # [ 186.249692] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 186.250206] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:47.399Z","message":"Shutting down"} gitlab # [ 186.251641] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:47.401Z","message":"Scheduler exiting..."} gitlab # [ 186.252464] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:47.402Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 186.253569] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:47.402Z","message":"Scheduler exiting..."} gitlab # [ 186.764958] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:47.914Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 188.268624] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:49.417Z","message":"Bye!"} gitlab # [ 188.291986] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-09-04T07:41:49.441Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1617,"worker_id":"sidekiq_0","memwd_rss_bytes":934252544,"retry":0} gitlab # [ 191.169763] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 191.172272] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 191.174467] systemd[1]: gitlab-sidekiq.service: Consumed 54.947s CPU time over 1min 58.089s wall clock time, 958.8M memory peak, 4.5M read from disk. gitlab # [ 191.179227] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 191.182085] setup-gitlab-start[2203]: + mkdir -p /var/lib/secrets gitlab # [ 191.184208] setup-gitlab-start[2203]: + echo nixbot-test-token-of-20-chars gitlab # [ 191.186462] setup-gitlab-start[2203]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 191.188891] setup-gitlab-start[2203]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 191.874633] gitaly[907]: time="2026-09-04T07:41:53.023Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.023" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.875096] gitaly[907]: time="2026-09-04T07:41:53.024Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.023" grpc.time_ms=0.47 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.968455] gitaly[907]: time="2026-09-04T07:41:53.118Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.096" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.117" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.990698] gitaly[907]: time="2026-09-04T07:41:53.140Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.096" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.117" grpc.time_ms=0.805 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.051683] gitaly[907]: time="2026-09-04T07:41:53.201Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA diskcache=5afa6e1a-4b54-4290-93e9-d5fcc1e6c98f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:42:03.129" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.149" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.073209] gitaly[907]: time="2026-09-04T07:41:53.202Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1580 command.oublock=32 command.real_time_ms=23 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:42:03.129" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.149" grpc.time_ms=52.526 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.074145] gitaly[907]: time="2026-09-04T07:41:53.219Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.198" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.218" pid=907 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 192.075280] gitaly[907]: time="2026-09-04T07:41:53.219Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.198" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.218" grpc.time_ms=0.619 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.085363] gitaly[907]: time="2026-09-04T07:41:53.235Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:03.203" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.224" grpc.time_ms=10.766 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.156470] gitaly[907]: time="2026-09-04T07:41:53.306Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.285" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.306" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.157234] gitaly[907]: time="2026-09-04T07:41:53.306Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.285" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.306" grpc.time_ms=0.286 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.210027] gitaly[907]: time="2026-09-04T07:41:53.360Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA diskcache=35494605-a946-4998-b804-2188fbbcdeca grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:42:03.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.327" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.219698] gitaly[907]: time="2026-09-04T07:41:53.369Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1574 command.oublock=32 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:42:03.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.327" grpc.time_ms=32.424 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.240337] gitaly[907]: time="2026-09-04T07:41:53.390Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.069" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.390" pid=907 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 192.241232] gitaly[907]: time="2026-09-04T07:41:53.390Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.069" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.390" grpc.time_ms=0.384 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.274153] gitaly[907]: time="2026-09-04T07:41:53.424Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:03.093" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.413" grpc.time_ms=10.226 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.327384] gitaly[907]: time="2026-09-04T07:41:53.477Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:03.156" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.477" grpc.time_ms=0.293 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.352069] gitaly[907]: time="2026-09-04T07:41:53.502Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:42:03.181" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.501" grpc.time_ms=0.222 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.768302] gitaly[907]: time="2026-09-04T07:41:53.918Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVTV0P7JBJY5KNAGZ38AA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:03.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:53.907" grpc.time_ms=10.647 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.124410] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:54 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 1921 gitlab # [ 193.128363] setup-gitlab-start[2203]: + mkdir -p /tmp/test-flake gitlab # [ 193.131258] setup-gitlab-start[2203]: + cd /tmp/test-flake gitlab # [ 193.132134] setup-gitlab-start[2203]: + git init -b master gitlab # [ 193.150713] setup-gitlab-start[2520]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 193.153651] setup-gitlab-start[2203]: + git config user.name test gitlab # [ 193.155748] setup-gitlab-start[2203]: + git config user.email test@example.com gitlab # [ 193.158151] setup-gitlab-start[2203]: + cat gitlab # [ 193.159694] setup-gitlab-start[2203]: + git add flake.nix gitlab # [ 193.161806] setup-gitlab-start[2203]: + git commit -m 'initial commit' gitlab # [ 193.173384] setup-gitlab-start[2525]: [master (root-commit) 0ffbe21] initial commit gitlab # [ 193.173564] setup-gitlab-start[2525]: 1 file changed, 10 insertions(+) gitlab # [ 193.174689] setup-gitlab-start[2525]: create mode 100644 flake.nix gitlab # [ 193.176311] setup-gitlab-start[2203]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 193.183819] setup-gitlab-start[2203]: + git push -u origin master gitlab # [ 193.263927] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 49 gitlab # [ 193.343423] gitaly[907]: time="2026-09-04T07:41:54.493Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWVG6YZ363QATE0E8M51 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:54.487" grpc.time_ms=5.625 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.343851] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 77 gitlab # [ 193.516205] gitaly[907]: time="2026-09-04T07:41:54.665Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:04.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:54.657" grpc.time_ms=8.316 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.560260] gitaly[907]: time="2026-09-04T07:41:54.710Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:42:24.001" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:41:54.702" grpc.time_ms=7.705 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.581587] gitaly[907]: time="2026-09-04T07:41:54.731Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT duration_ms=123ns method=POST pid=907 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 193.606276] gitaly[907]: time="2026-09-04T07:41:54.756Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT duration_ms=21ns method=POST pid=907 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 193.609395] gitaly[907]: time="2026-09-04T07:41:54.756Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:54.607" grpc.time_ms=149.741 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.652238] gitaly[907]: time="2026-09-04T07:41:54.802Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:54.801" grpc.time_ms=0.911 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.683032] gitaly[907]: time="2026-09-04T07:41:54.833Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:54.832" grpc.time_ms=0.297 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.709293] gitaly[907]: time="2026-09-04T07:41:54.859Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:54.858" grpc.time_ms=0.263 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.930057] gitaly[907]: time="2026-09-04T07:41:55.080Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:05.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:55.074" grpc.time_ms=5.424 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.984890] gitaly[907]: time="2026-09-04T07:41:55.134Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:42:05.045" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:41:55.115" grpc.time_ms=19.427 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.036709] gitaly[907]: time="2026-09-04T07:41:55.186Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT duration_ms=301ns method=POST pid=907 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 194.040361] gitaly[907]: time="2026-09-04T07:41:55.190Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:54.884" grpc.time_ms=305.502 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 194.063674] gitaly[907]: time="2026-09-04T07:41:55.213Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT diskcache=28f3bee8-5726-4d33-9b2b-a6635c5d6d70 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:54.562" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 194.064481] gitaly[907]: time="2026-09-04T07:41:55.213Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=182 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13649 command.oublock=32 command.real_time_ms=642 command.spawn_token_fork_ms=1 command.system_time_ms=134 command.user_time_ms=48 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:54.562" grpc.time_ms=650.995 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 194.065582] gitlab-workhorse[827]: time="2026-09-04T07:41:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 194.066598] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:55 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 700 gitlab # [ 194.093173] setup-gitlab-start[2529]: To http://gitlab/root/test-flake.git gitlab # [ 194.093840] setup-gitlab-start[2529]: * [new branch] master -> master gitlab # [ 194.098154] setup-gitlab-start[2529]: branch 'master' set up to track 'origin/master'. gitlab # [ 194.101643] systemd[1]: Finished setup-gitlab.service. gitlab # [ 194.104520] systemd[1]: Starting nixbot CI service... gitlab # [ 194.195518] sidekiq-cluster[2473]: {"severity":"INFO","time":"2026-09-04T07:41:55.328Z","message":"Starting cluster with 1 processes"} gitlab: (finished: waiting for unit setup-gitlab.service, in 195.25 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 195.274880] nixbot[2616]: {"ts": "2026-09-04T07:41:56.424Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 195.304632] nixbot[2616]: {"ts": "2026-09-04T07:41:56.454Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 195.318335] nixbot[2616]: {"ts": "2026-09-04T07:41:56.468Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 195.322109] nixbot[2616]: {"ts": "2026-09-04T07:41:56.472Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 195.324938] nixbot[2616]: {"ts": "2026-09-04T07:41:56.474Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 195.329340] nixbot[2616]: {"ts": "2026-09-04T07:41:56.479Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 195.332288] nixbot[2616]: {"ts": "2026-09-04T07:41:56.482Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 195.334322] nixbot[2616]: {"ts": "2026-09-04T07:41:56.484Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 195.342433] nixbot[2616]: {"ts": "2026-09-04T07:41:56.492Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 195.346824] nixbot[2616]: {"ts": "2026-09-04T07:41:56.496Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 195.355618] nixbot[2616]: {"ts": "2026-09-04T07:41:56.505Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 195.362795] nixbot[2616]: {"ts": "2026-09-04T07:41:56.512Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 195.368678] nixbot[2616]: {"ts": "2026-09-04T07:41:56.518Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 195.373450] nixbot[2616]: {"ts": "2026-09-04T07:41:56.523Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 195.380202] nixbot[2616]: {"ts": "2026-09-04T07:41:56.530Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 195.385372] nixbot[2616]: {"ts": "2026-09-04T07:41:56.535Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 195.388587] nixbot[2616]: {"ts": "2026-09-04T07:41:56.538Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 195.392639] nixbot[2616]: {"ts": "2026-09-04T07:41:56.542Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 195.400600] nixbot[2616]: {"ts": "2026-09-04T07:41:56.550Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 195.403596] nixbot[2616]: {"ts": "2026-09-04T07:41:56.553Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 195.407543] nixbot[2616]: {"ts": "2026-09-04T07:41:56.557Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 195.413270] nixbot[2616]: {"ts": "2026-09-04T07:41:56.563Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 195.417185] nixbot[2616]: {"ts": "2026-09-04T07:41:56.567Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 195.422090] nixbot[2616]: {"ts": "2026-09-04T07:41:56.572Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 195.426051] nixbot[2616]: {"ts": "2026-09-04T07:41:56.576Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 195.430223] nixbot[2616]: {"ts": "2026-09-04T07:41:56.580Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"} gitlab # [ 195.434459] nixbot[2616]: {"ts": "2026-09-04T07:41:56.584Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"} gitlab # [ 195.438641] nixbot[2616]: {"ts": "2026-09-04T07:41:56.588Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"} gitlab # [ 195.442559] nixbot[2616]: {"ts": "2026-09-04T07:41:56.592Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"} gitlab # [ 195.459633] nixbot[2616]: {"ts": "2026-09-04T07:41:56.609Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"} gitlab # [ 195.463106] nixbot[2616]: {"ts": "2026-09-04T07:41:56.613Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"} gitlab # [ 195.837088] nixbot[2616]: INFO: Started server process [2616] gitlab # [ 195.838170] nixbot[2616]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 195.859424] nixbot[2616]: INFO: ::ffff:127.0.0.1:42908 - "GET /health HTTP/1.1" 200 OK gitlab # [ 195.865329] systemd[1]: Started nixbot CI service. gitlab # [ 195.867895] systemd[1]: Reached target Multi-User System. gitlab # [ 195.868850] systemd[1]: Startup finished in 1.286s (kernel) + 3.593s (initrd) + 3min 10.988s (userspace) = 3min 15.868s. gitlab # [ 196.607610] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:57 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 748 gitlab # [ 196.614728] nixbot[2616]: {"ts": "2026-09-04T07:41:57.764Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 196.645116] nixbot[2616]: {"ts": "2026-09-04T07:41:57.795Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 196.699501] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 45 gitlab # [ 196.707066] nixbot[2616]: {"ts": "2026-09-04T07:41:57.855Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 196.713471] nixbot[2616]: {"ts": "2026-09-04T07:41:57.863Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab: (finished: waiting for unit nixbot.service, in 2.08 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 196.752193] nixbot[2616]: INFO: ::ffff:127.0.0.1:42922 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 196.812142] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 36 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.06 seconds) gitlab # [ 196.844663] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 123 gitlab # [ 196.849939] nixbot[2616]: {"ts": "2026-09-04T07:41:58.000Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 197.041437] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:58 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 185 gitlab # [ 197.044160] nixbot[2616]: {"ts": "2026-09-04T07:41:58.194Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 197.114370] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 62 gitlab # [ 197.115353] nixbot[2616]: {"ts": "2026-09-04T07:41:58.265Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 197.163360] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:58 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 44 gitlab # [ 197.165902] nixbot[2616]: {"ts": "2026-09-04T07:41:58.316Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 197.212499] gitaly[907]: time="2026-09-04T07:41:58.362Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW0NH3DRRXAMJSJPAYWHB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-04T07:42:28.051" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:41:58.351" grpc.time_ms=10.328 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.233298] gitaly[907]: time="2026-09-04T07:41:58.383Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW0NH3DRRXAMJSJPAYWHB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:42:28.082" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:41:58.382" grpc.time_ms=0.446 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.251465] gitaly[907]: time="2026-09-04T07:41:58.401Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW0NH3DRRXAMJSJPAYWHB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-04T07:42:08.006" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:41:58.396" grpc.time_ms=5.207 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.271047] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 99 gitlab # [ 197.273723] nixbot[2616]: {"ts": "2026-09-04T07:41:58.423Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 197.331174] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 52 gitlab # [ 197.331952] nixbot[2616]: {"ts": "2026-09-04T07:41:58.482Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 197.334407] nixbot[2616]: {"ts": "2026-09-04T07:41:58.484Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 197.395607] gitaly[907]: time="2026-09-04T07:41:58.545Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW0VEMTYSMW9SQ69MZAV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.539" grpc.time_ms=6.299 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.396170] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 35 gitlab # [ 197.451243] gitaly[907]: time="2026-09-04T07:41:58.601Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW0WK8Y422Y2DV29A8F2V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.593" pid=907 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 197.451495] gitaly[907]: time="2026-09-04T07:41:58.601Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW0WK8Y422Y2DV29A8F2V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.593" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.452065] gitaly[907]: time="2026-09-04T07:41:58.601Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW0WK8Y422Y2DV29A8F2V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.593" grpc.time_ms=8.049 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.495850] gitlab-workhorse[827]: time="2026-09-04T07:41:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 197.496317] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 98 gitlab # [ 197.620299] gitaly[907]: time="2026-09-04T07:41:58.770Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW0ZWRG086BSS3QHPCS7C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.758" pid=907 remote_ip="2001:db8:1::1" request_sha=0296bc7fff626834989bdc36bc240ed1d8ffbb60 response_bytes=224 span.kind=server system=grpc gitlab # [ 197.642077] gitaly[907]: time="2026-09-04T07:41:58.770Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1200 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW0ZWRG086BSS3QHPCS7C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.758" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.668887] gitlab-workhorse[827]: time="2026-09-04T07:41:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=224 gitlab # [ 197.672317] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 119 gitlab # [ 197.675823] gitaly[907]: time="2026-09-04T07:41:58.770Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1200 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW0ZWRG086BSS3QHPCS7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.758" grpc.time_ms=11.787 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.755720] gitaly[907]: time="2026-09-04T07:41:58.905Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW16GXMS15C9JJB3CJY3X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.898" grpc.time_ms=7.366 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.782970] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 41 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 197.851663] gitaly[907]: time="2026-09-04T07:41:59.001Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW18T9WY9ATXCY13MFRM2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.991" pid=907 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 197.852318] gitaly[907]: time="2026-09-04T07:41:59.001Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW18T9WY9ATXCY13MFRM2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.991" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.888854] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 43 gitlab # [ 197.890708] gitlab-workhorse[827]: time="2026-09-04T07:41:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 197.891881] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 102 gitlab # [ 197.892606] gitaly[907]: time="2026-09-04T07:41:59.039Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW18T9WY9ATXCY13MFRM2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:58.991" grpc.time_ms=48.683 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds) (finished: subtest: project discovered and webhook registered, in 1.16 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 197.965703] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:59 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 26 gitlab # [ 197.985615] gitaly[907]: time="2026-09-04T07:41:59.135Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1DB68J28HZ6ADRW0D2R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:59.129" grpc.time_ms=5.938 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 197.987092] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 52 gitlab # [ 198.048615] gitaly[907]: time="2026-09-04T07:41:59.198Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1EC1S5YG8B73EVFDJZJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:59.192" grpc.time_ms=5.841 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.064318] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:59 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 97 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # [ 198.079041] gitaly[907]: time="2026-09-04T07:41:59.229Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1FKSJBTG1X1QXNBAYPB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:59.197" pid=907 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 198.079838] gitaly[907]: time="2026-09-04T07:41:59.229Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1FKSJBTG1X1QXNBAYPB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:59.197" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 198.082156] gitaly[907]: time="2026-09-04T07:41:59.230Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1FKSJBTG1X1QXNBAYPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:59.197" grpc.time_ms=32.088 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 198.082798] gitlab-workhorse[827]: time="2026-09-04T07:41:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 198.083549] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 75 gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 5.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 198.215430] gitaly[907]: time="2026-09-04T07:41:59.365Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:42:29.063" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:41:59.364" grpc.time_ms=0.437 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.241293] gitaly[907]: time="2026-09-04T07:41:59.391Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:42:29.084" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:41:59.385" grpc.time_ms=6.289 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.257801] gitaly[907]: time="2026-09-04T07:41:59.407Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:09.082" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:41:59.402" grpc.time_ms=4.979 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.271744] gitaly[907]: time="2026-09-04T07:41:59.421Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:09.094" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:41:59.415" grpc.time_ms=6.75 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.326233] gitaly[907]: time="2026-09-04T07:41:59.476Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:42:09.155" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:59.475" grpc.time_ms=0.183 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.346282] gitaly[907]: time="2026-09-04T07:41:59.495Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=616 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=6 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:42:09.163" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:41:59.483" grpc.time_ms=12.377 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.375758] gitaly[907]: time="2026-09-04T07:41:59.525Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:59.525" grpc.time_ms=0.336 pid=907 span.kind=server system=grpc gitlab # [ 198.395693] gitaly[907]: time="2026-09-04T07:41:59.545Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:42:29.238" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:41:59.539" grpc.time_ms=6.632 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.408531] gitaly[907]: time="2026-09-04T07:41:59.558Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:59.558" grpc.time_ms=0.381 pid=907 span.kind=server system=grpc gitlab # [ 198.433210] gitaly[907]: time="2026-09-04T07:41:59.583Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 diskcache=ad2dc336-94b1-4562-8ad5-5b8dfe209318 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:42:09.177" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:59.497" pid=907 ref=refs/keep-around/0ffbe21bac32f8e9be026bc462d5eaed72c6191f remote_ip="2001:db8:1::1" revision=0ffbe21bac32f8e9be026bc462d5eaed72c6191f span.kind=server system=grpc username=root gitlab # [ 198.441715] gitaly[907]: time="2026-09-04T07:41:59.591Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NNW1KKQZGN4FA4EH395DGY duration_ms=146ns method=POST pid=907 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 198.450408] gitaly[907]: time="2026-09-04T07:41:59.600Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=53 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5302 command.oublock=8 command.real_time_ms=75 command.spawn_token_fork_ms=2 command.system_time_ms=36 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:42:09.177" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:41:59.497" grpc.time_ms=85.587 pid=907 ref=refs/keep-around/0ffbe21bac32f8e9be026bc462d5eaed72c6191f remote_ip="2001:db8:1::1" revision=0ffbe21bac32f8e9be026bc462d5eaed72c6191f span.kind=server system=grpc username=root gitlab # [ 198.474140] gitaly[907]: time="2026-09-04T07:41:59.622Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:42:29.321" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:41:59.621" grpc.time_ms=0.531 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.481809] gitaly[907]: time="2026-09-04T07:41:59.631Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NNW1KKQZGN4FA4EH395DGY duration_ms=39ns method=POST pid=907 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 198.482736] gitaly[907]: time="2026-09-04T07:41:59.632Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:59.445" grpc.time_ms=186.999 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.528559] gitaly[907]: time="2026-09-04T07:41:59.678Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:59.678" grpc.time_ms=0.421 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.569737] gitaly[907]: time="2026-09-04T07:41:59.719Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:59.718" grpc.time_ms=0.44 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.602194] gitaly[907]: time="2026-09-04T07:41:59.752Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:59.752" grpc.time_ms=0.301 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.648870] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 485 gitlab # [ 198.653461] nixbot[2616]: {"ts": "2026-09-04T07:41:59.803Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f \"HTTP/1.1 201 Created\""} gitlab # [ 198.668381] nixbot[2616]: {"ts": "2026-09-04T07:41:59.818Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-0ffbe21bac32-0"} gitlab # [ 198.672227] gitaly[907]: time="2026-09-04T07:41:59.822Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NNW1KKQZGN4FA4EH395DGY duration_ms=36ns method=POST pid=907 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 198.676307] gitaly[907]: time="2026-09-04T07:41:59.822Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:41:59.785" grpc.time_ms=37.439 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.697622] gitaly[907]: time="2026-09-04T07:41:59.847Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY diskcache=00fe86d3-158b-44d7-9f7d-edee7f789c3c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:59.340" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.699174] gitlab-workhorse[827]: time="2026-09-04T07:41:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 198.700036] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:59 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 564 gitlab # [ 198.714652] gitaly[907]: time="2026-09-04T07:41:59.864Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=168 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=868352 command.minflt=13129 command.oublock=32 command.real_time_ms=498 command.spawn_token_fork_ms=0 command.system_time_ms=104 command.user_time_ms=64 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:41:59.340" grpc.time_ms=507.747 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # 0ffbe21..b6d0f44 master -> master gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.84 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 198.810336] nixbot[2616]: INFO: ::ffff:127.0.0.1:42924 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.06 seconds) gitlab # [ 198.850263] nixbot[2616]: {"ts": "2026-09-04T07:42:00.000Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-0ffbe21bac32-0", "argv0": "bwrap"} gitlab # [ 198.933835] systemd[1]: Started Nix Daemon. gitlab # [ 198.990449] nix-daemon[2845]: accepted connection from pid 2840, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 199.853671] nixbot[2616]: INFO: ::ffff:127.0.0.1:42932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 200.896097] nixbot[2616]: INFO: ::ffff:127.0.0.1:42942 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 201.938362] nixbot[2616]: INFO: ::ffff:127.0.0.1:42944 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 202.980119] nixbot[2616]: INFO: ::ffff:127.0.0.1:45126 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab # [ 203.459230] nix-daemon[2845]: accepted connection from pid 2872, user nixbot gitlab # [ 203.476677] nix-daemon[2845]: accepted connection from pid 2840, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 204.017233] nixbot[2616]: INFO: ::ffff:127.0.0.1:45130 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.03 seconds) gitlab # [ 205.054994] nixbot[2616]: INFO: ::ffff:127.0.0.1:45144 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 206.094113] nixbot[2616]: INFO: ::ffff:127.0.0.1:45154 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 207.135484] nixbot[2616]: INFO: ::ffff:127.0.0.1:45166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab # [ 207.574919] nix-daemon[2845]: accepted connection from pid 2840, user nixbot gitlab # [ 207.675100] nix-daemon[2845]: accepted connection from pid 2901, user nixbot gitlab # [ 207.717459] gitaly[907]: time="2026-09-04T07:42:08.865Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWAWY7H8R2MMM4S080ZHX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:42:38.563" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:08.864" grpc.time_ms=0.669 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.761285] gitaly[907]: time="2026-09-04T07:42:08.911Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NNWAWY7H8R2MMM4S080ZHX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:18.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:08.902" grpc.time_ms=9.039 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.800488] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 150 gitlab # [ 207.806122] nixbot[2616]: {"ts": "2026-09-04T07:42:08.949Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f \"HTTP/1.1 201 Created\""} gitlab # [ 207.852248] gitaly[907]: time="2026-09-04T07:42:09.002Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWB1REAN0JJGAD549PJ4N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:42:39.000" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:09.001" grpc.time_ms=0.862 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.998546] gitaly[907]: time="2026-09-04T07:42:09.148Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNWB1REAN0JJGAD549PJ4N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:19.067" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:09.138" grpc.time_ms=10.263 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.090230] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 286 gitlab # [ 208.096249] nixbot[2616]: {"ts": "2026-09-04T07:42:09.240Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 208.176502] nixbot[2616]: INFO: ::ffff:127.0.0.1:45180 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 209.206535] nixbot[2616]: INFO: ::ffff:127.0.0.1:45194 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 210.246151] nixbot[2616]: INFO: ::ffff:127.0.0.1:45206 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 211.287123] nixbot[2616]: INFO: ::ffff:127.0.0.1:45210 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 212.325570] nixbot[2616]: INFO: ::ffff:127.0.0.1:45214 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab # [ 212.532105] nix-daemon[2845]: accepted connection from pid 2944, user nixbot gitlab # [ 212.617929] gitaly[907]: time="2026-09-04T07:42:13.767Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWFPF1N7XRQZ44VVZD735 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:42:43.466" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:13.766" grpc.time_ms=0.729 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.668802] gitaly[907]: time="2026-09-04T07:42:13.818Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNWFPF1N7XRQZ44VVZD735 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:23.162" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:13.812" grpc.time_ms=5.992 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.702100] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 138 gitlab # [ 212.707889] nixbot[2616]: {"ts": "2026-09-04T07:42:13.857Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f \"HTTP/1.1 201 Created\""} gitlab # [ 212.872427] gitaly[907]: time="2026-09-04T07:42:14.022Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNWFYS5HAXKVDR9DD9BK16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.013" grpc.time_ms=8.487 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.874318] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 45 gitlab # [ 212.923072] gitaly[907]: time="2026-09-04T07:42:14.072Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWG091CF8T8TE90KCGCX5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.061" pid=907 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 212.923884] gitaly[907]: time="2026-09-04T07:42:14.072Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWG091CF8T8TE90KCGCX5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.061" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.926514] gitlab-workhorse[827]: time="2026-09-04T07:42:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 212.927919] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 47 gitlab # [ 212.929433] gitaly[907]: time="2026-09-04T07:42:14.073Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWG091CF8T8TE90KCGCX5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.061" grpc.time_ms=11.027 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.992482] gitaly[907]: time="2026-09-04T07:42:14.142Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWG1V8TPESSZ1A0V3P3AM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.126" pid=907 remote_ip="2001:db8:1::1" request_sha=af3614bd7df3f09e642948d79cf179e49dd295b7 response_bytes=337 span.kind=server system=grpc gitlab # [ 212.993487] gitaly[907]: time="2026-09-04T07:42:14.142Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWG1V8TPESSZ1A0V3P3AM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.126" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.994627] gitlab-workhorse[827]: time="2026-09-04T07:42:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=337 gitlab # [ 212.995527] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 67 gitlab # [ 212.996249] gitaly[907]: time="2026-09-04T07:42:14.142Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWG1V8TPESSZ1A0V3P3AM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.126" grpc.time_ms=15.884 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.124950] gitaly[907]: time="2026-09-04T07:42:14.274Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNWG6JWTE15V5WSDFAWQFS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.267" grpc.time_ms=7.611 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.125715] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 48 gitlab # [ 213.162142] gitaly[907]: time="2026-09-04T07:42:14.312Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWG84CXKHFQFEJ3E50X6E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.306" pid=907 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 213.162348] gitaly[907]: time="2026-09-04T07:42:14.312Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWG84CXKHFQFEJ3E50X6E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.306" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.162955] gitaly[907]: time="2026-09-04T07:42:14.312Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWG84CXKHFQFEJ3E50X6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.306" grpc.time_ms=6.165 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.163560] gitlab-workhorse[827]: time="2026-09-04T07:42:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 213.164090] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 36 gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 213.357264] gitaly[907]: time="2026-09-04T07:42:14.507Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNWGB6PS83TN34C681YJ9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.487" grpc.time_ms=19.465 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.361738] nixbot[2616]: INFO: ::ffff:127.0.0.1:59350 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.06 seconds) gitlab # [ 213.391126] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 166 gitlab # [ 213.464783] gitaly[907]: time="2026-09-04T07:42:14.614Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWGGJKFSQ783M9YGSEC90 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.603" pid=907 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 213.486901] gitaly[907]: time="2026-09-04T07:42:14.615Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWGGJKFSQ783M9YGSEC90 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.603" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.513063] gitaly[907]: time="2026-09-04T07:42:14.663Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNWGGJKFSQ783M9YGSEC90 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:14.603" grpc.time_ms=59.22 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 213.528263] gitlab-workhorse[827]: time="2026-09-04T07:42:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 213.529092] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 132 gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 214.422786] nixbot[2616]: INFO: ::ffff:127.0.0.1:59362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 215.457452] nixbot[2616]: INFO: ::ffff:127.0.0.1:59378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.03 seconds) gitlab # [ 216.490176] nixbot[2616]: INFO: ::ffff:127.0.0.1:59390 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 217.524922] nixbot[2616]: INFO: ::ffff:127.0.0.1:59392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 218.561740] nixbot[2616]: INFO: ::ffff:127.0.0.1:59400 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab # [ 218.711654] sidekiq-cluster[2622]: 2026-09-04T07:42:19.860Z pid=2622 tid=xau INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2622, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>448704512} gitlab # [ 218.876977] sidekiq-cluster[2622]: W, [2026-09-04T07:42:20.026931 #2622] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 218.913599] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:20.063Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 219.601168] nixbot[2616]: INFO: ::ffff:127.0.0.1:59408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 220.641336] nixbot[2616]: INFO: ::ffff:127.0.0.1:59414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab # [ 220.960907] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:22.110Z","message":"GitLab reliable fetch activated!"} gitlab # [ 220.961134] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:22.110Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 221.678135] nixbot[2616]: INFO: ::ffff:127.0.0.1:59418 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 222.715166] nixbot[2616]: INFO: ::ffff:127.0.0.1:59420 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 223.753267] nixbot[2616]: INFO: ::ffff:127.0.0.1:59794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 224.791912] nixbot[2616]: INFO: ::ffff:127.0.0.1:59800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 225.831283] nixbot[2616]: INFO: ::ffff:127.0.0.1:59812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 226.870692] nixbot[2616]: INFO: ::ffff:127.0.0.1:59824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 227.908174] nixbot[2616]: INFO: ::ffff:127.0.0.1:59836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 228.946974] nixbot[2616]: INFO: ::ffff:127.0.0.1:59838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 229.983365] nixbot[2616]: INFO: ::ffff:127.0.0.1:59854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 231.020702] nixbot[2616]: INFO: ::ffff:127.0.0.1:59858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 232.059082] nixbot[2616]: INFO: ::ffff:127.0.0.1:59870 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 233.095731] nixbot[2616]: INFO: ::ffff:127.0.0.1:45234 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 234.129762] nixbot[2616]: INFO: ::ffff:127.0.0.1:45248 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 235.166118] nixbot[2616]: INFO: ::ffff:127.0.0.1:45258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 236.204691] nixbot[2616]: INFO: ::ffff:127.0.0.1:45264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 237.243619] nixbot[2616]: INFO: ::ffff:127.0.0.1:45276 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 238.280931] nixbot[2616]: INFO: ::ffff:127.0.0.1:45280 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 239.315095] nixbot[2616]: INFO: ::ffff:127.0.0.1:45282 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 240.349890] nixbot[2616]: INFO: ::ffff:127.0.0.1:45298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab # [ 240.460443] postgres[3122]: [3122] ERROR: relation "table_without_models" does not exist gitlab # [ 240.460808] postgres[3122]: [3122] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 241.388445] nixbot[2616]: INFO: ::ffff:127.0.0.1:45304 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 242.424933] nixbot[2616]: INFO: ::ffff:127.0.0.1:45306 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab # [ 242.834992] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:43.984Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 242.836458] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:43.986Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 242.838073] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:43.986Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 242.839147] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:43.986Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 242.840300] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:43.987Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 243.461846] nixbot[2616]: INFO: ::ffff:127.0.0.1:47512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.04 seconds) gitlab # [ 244.113360] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.262Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"58e22a795d658cc9bcca70f7","created_at":"2026-09-04T07:41:53.247Z","trace_propagation_headers":{"sentry-trace":"826fe349be33489b9b693e59e61da56d-5010b583b4b04ce9","baggage":"sentry-trace_id=826fe349be33489b9b693e59e61da56d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVTV0P7JBJY5KNAGZ38AA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:53.271Z","job_size_bytes":2,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-58e22a795d658cc9bcca70f7: start","job_status":"start","queue_duration_s":51.99096,"scheduling_latency_s":51.991005} gitlab # [ 244.343749] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.493Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"58e22a795d658cc9bcca70f7","created_at":"2026-09-04T07:41:53.247Z","trace_propagation_headers":{"sentry-trace":"826fe349be33489b9b693e59e61da56d-5010b583b4b04ce9","baggage":"sentry-trace_id=826fe349be33489b9b693e59e61da56d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVTV0P7JBJY5KNAGZ38AA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:53.271Z","job_size_bytes":2,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-58e22a795d658cc9bcca70f7: done: 0.230737 sec","job_status":"done","queue_duration_s":51.99096,"scheduling_latency_s":51.991005,"redis_calls":25,"redis_duration_s":0.007755,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004314,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001849,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.100871758,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.230737,"completed_at":"2026-09-04T07:42:45.493Z","load_balancing_strategy":"primary","db_duration_s":0.062373,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.345571] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.494Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"0486b0fd71f9b8cb83a9b327","created_at":"2026-09-04T07:41:53.289Z","trace_propagation_headers":{"sentry-trace":"826fe349be33489b9b693e59e61da56d-5010b583b4b04ce9","baggage":"sentry-trace_id=826fe349be33489b9b693e59e61da56d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVTV0P7JBJY5KNAGZ38AA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:53.299Z","job_size_bytes":2,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-0486b0fd71f9b8cb83a9b327: start","job_status":"start","queue_duration_s":52.195738,"scheduling_latency_s":52.195753} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 244.426417] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.574Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"0486b0fd71f9b8cb83a9b327","created_at":"2026-09-04T07:41:53.289Z","trace_propagation_headers":{"sentry-trace":"826fe349be33489b9b693e59e61da56d-5010b583b4b04ce9","baggage":"sentry-trace_id=826fe349be33489b9b693e59e61da56d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVTV0P7JBJY5KNAGZ38AA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:53.299Z","job_size_bytes":2,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-0486b0fd71f9b8cb83a9b327: done: 0.079306 sec","job_status":"done","queue_duration_s":52.195738,"scheduling_latency_s":52.195753,"redis_calls":14,"redis_duration_s":0.003171,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000678,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001421,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.062271322,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.079306,"completed_at":"2026-09-04T07:42:45.574Z","load_balancing_strategy":"primary","db_duration_s":0.024816,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.467768] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.575Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"f1c5ec7a902b053def97c724","created_at":"2026-09-04T07:41:53.832Z","trace_propagation_headers":{"sentry-trace":"826fe349be33489b9b693e59e61da56d-5010b583b4b04ce9","baggage":"sentry-trace_id=826fe349be33489b9b693e59e61da56d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVTV0P7JBJY5KNAGZ38AA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:53.837Z","job_size_bytes":5,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-f1c5ec7a902b053def97c724: start","job_status":"start","queue_duration_s":51.737839,"scheduling_latency_s":51.737854} gitlab # [ 244.520304] nixbot[2616]: INFO: ::ffff:127.0.0.1:47516 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.06 seconds) gitlab # [ 244.558188] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.707Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"f1c5ec7a902b053def97c724","created_at":"2026-09-04T07:41:53.832Z","trace_propagation_headers":{"sentry-trace":"826fe349be33489b9b693e59e61da56d-5010b583b4b04ce9","baggage":"sentry-trace_id=826fe349be33489b9b693e59e61da56d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVTV0P7JBJY5KNAGZ38AA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:53.837Z","job_size_bytes":5,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-f1c5ec7a902b053def97c724: done: 0.132519 sec","job_status":"done","queue_duration_s":51.737839,"scheduling_latency_s":51.737854,"redis_calls":12,"redis_duration_s":0.002855,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000745,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001597,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000289701,"duration_s":0.132519,"completed_at":"2026-09-04T07:42:45.707Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026501,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.559723] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.709Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"78777d2942d87473104018af","created_at":"2026-09-04T07:41:53.858Z","trace_propagation_headers":{"sentry-trace":"826fe349be33489b9b693e59e61da56d-5010b583b4b04ce9","baggage":"sentry-trace_id=826fe349be33489b9b693e59e61da56d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVTV0P7JBJY5KNAGZ38AA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:53.862Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-78777d2942d87473104018af: start","job_status":"start","queue_duration_s":51.846818,"scheduling_latency_s":51.846833} gitlab # [ 244.710961] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.860Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"78777d2942d87473104018af","created_at":"2026-09-04T07:41:53.858Z","trace_propagation_headers":{"sentry-trace":"826fe349be33489b9b693e59e61da56d-5010b583b4b04ce9","baggage":"sentry-trace_id=826fe349be33489b9b693e59e61da56d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVTV0P7JBJY5KNAGZ38AA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:53.862Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-78777d2942d87473104018af: done: 0.151408 sec","job_status":"done","queue_duration_s":51.846818,"scheduling_latency_s":51.846833,"redis_calls":11,"redis_duration_s":0.002698,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000627,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000419,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.126,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.126,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000448101,"duration_s":0.151408,"completed_at":"2026-09-04T07:42:45.860Z","load_balancing_strategy":"primary","db_duration_s":0.069995,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.712409] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.862Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"36fd592ddde80ae252e276a3","created_at":"2026-09-04T07:41:53.864Z","trace_propagation_headers":{"sentry-trace":"826fe349be33489b9b693e59e61da56d-5010b583b4b04ce9","baggage":"sentry-trace_id=826fe349be33489b9b693e59e61da56d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVTV0P7JBJY5KNAGZ38AA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:53.867Z","job_size_bytes":89,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-36fd592ddde80ae252e276a3: start","job_status":"start","queue_duration_s":51.994436,"scheduling_latency_s":51.99445} gitlab # [ 244.785984] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.888Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"36fd592ddde80ae252e276a3","created_at":"2026-09-04T07:41:53.864Z","trace_propagation_headers":{"sentry-trace":"826fe349be33489b9b693e59e61da56d-5010b583b4b04ce9","baggage":"sentry-trace_id=826fe349be33489b9b693e59e61da56d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVTV0P7JBJY5KNAGZ38AA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:53.867Z","job_size_bytes":89,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-36fd592ddde80ae252e276a3: done: 0.02641 sec","job_status":"done","queue_duration_s":51.994436,"scheduling_latency_s":51.99445,"redis_calls":11,"redis_duration_s":0.002336,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000637,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000288305,"duration_s":0.02641,"completed_at":"2026-09-04T07:42:45.888Z","load_balancing_strategy":"primary","db_duration_s":0.005874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.830993] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.889Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 0ffbe21bac32f8e9be026bc462d5eaed72c6191f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"da2c11da46b42a51cf145117","created_at":"2026-09-04T07:41:55.022Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-04884db533c1417e","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:55.042Z","job_size_bytes":185,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-da2c11da46b42a51cf145117: start","job_status":"start","queue_duration_s":50.846767,"scheduling_latency_s":50.84678} gitlab # [ 244.832093] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:45.901Z","message":"changes: \"0000000000000000000000000000000000000000 0ffbe21bac32f8e9be026bc462d5eaed72c6191f refs/heads/master\\n\""} gitlab # [ 244.833565] gitaly[907]: time="2026-09-04T07:42:45.928Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:55.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:45.921" grpc.time_ms=6.164 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.834670] gitaly[907]: time="2026-09-04T07:42:45.942Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:55.011" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:45.931" grpc.time_ms=10.098 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.880996] gitaly[907]: time="2026-09-04T07:42:46.031Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=52 command.spawn_token_fork_ms=42 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T07:42:55.055" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:45.975" grpc.time_ms=55.227 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.916465] gitaly[907]: time="2026-09-04T07:42:46.066Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3932 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:46.065" grpc.time_ms=1.185 pid=907 span.kind=server system=grpc gitlab # [ 244.958712] gitaly[907]: time="2026-09-04T07:42:46.108Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3934 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:46.108" grpc.time_ms=0.381 pid=907 span.kind=server system=grpc gitlab # [ 244.976255] gitaly[907]: time="2026-09-04T07:42:46.126Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT diskcache=4ed2fc3a-689f-4104-b0cf-c0b85bec21d9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:42:56.013" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:46.043" pid=907 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 244.976954] gitaly[907]: time="2026-09-04T07:42:46.126Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=61 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5216 command.oublock=8 command.real_time_ms=75 command.spawn_token_fork_ms=0 command.system_time_ms=40 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:42:56.013" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:46.043" grpc.time_ms=82.57 pid=907 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 244.991520] gitaly[907]: time="2026-09-04T07:42:46.141Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:56.110" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:46.141" grpc.time_ms=0.28 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.010717] gitaly[907]: time="2026-09-04T07:42:46.160Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=936 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:42:56.115" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:46.146" grpc.time_ms=14.536 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.088761] gitaly[907]: time="2026-09-04T07:42:46.238Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-04T07:43:16.032" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:46.233" grpc.time_ms=5.283 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.109807] gitaly[907]: time="2026-09-04T07:42:46.259Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:42:56.228" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:46.259" grpc.time_ms=0.358 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.117142] gitaly[907]: time="2026-09-04T07:42:46.267Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T07:42:56.230" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T07:42:46.261" grpc.time_ms=6.15 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.135402] gitaly[907]: time="2026-09-04T07:42:46.285Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:56.245" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:46.275" grpc.time_ms=9.758 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.146254] gitaly[907]: time="2026-09-04T07:42:46.296Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:56.258" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:46.288" grpc.time_ms=7.383 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.170661] gitaly[907]: time="2026-09-04T07:42:46.320Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:43:16.104" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:46.304" grpc.time_ms=15.929 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 245.506305] gitaly[907]: time="2026-09-04T07:42:46.656Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T07:42:56.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:46.655" grpc.time_ms=0.984 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.561107] nixbot[2616]: INFO: ::ffff:127.0.0.1:47532 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab # [ 245.562791] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:46.710Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 0ffbe21bac32f8e9be026bc462d5eaed72c6191f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"da2c11da46b42a51cf145117","created_at":"2026-09-04T07:41:55.022Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-04884db533c1417e","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:55.042Z","job_size_bytes":185,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-da2c11da46b42a51cf145117: done: 0.82108 sec","job_status":"done","queue_duration_s":50.846767,"scheduling_latency_s":50.84678,"gitaly_calls":13,"gitaly_duration_s":0.276378,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.041105,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.003929,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.005947,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001371,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003768,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.015443,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.010647,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.168,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.192,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.43215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000436369,"exclusive_lock_hold_duration_s":0.020612955000000002,"duration_s":0.82108,"completed_at":"2026-09-04T07:42:46.710Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.092298,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.11 seconds) gitlab # [ 245.632314] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:46.782Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4dbafbf753777e967cdda557","created_at":"2026-09-04T07:41:59.624Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-5d3b47f23f9b4189","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:59.658Z","job_size_bytes":65,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4dbafbf753777e967cdda557: start","job_status":"start","queue_duration_s":47.123229,"scheduling_latency_s":47.123258} gitlab # [ 245.739341] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:46.888Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4dbafbf753777e967cdda557","created_at":"2026-09-04T07:41:59.624Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-5d3b47f23f9b4189","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:59.658Z","job_size_bytes":65,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4dbafbf753777e967cdda557: done: 0.106796 sec","job_status":"done","queue_duration_s":47.123229,"scheduling_latency_s":47.123258,"redis_calls":16,"redis_duration_s":0.004293,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002076,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000737,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000552026,"duration_s":0.106796,"completed_at":"2026-09-04T07:42:46.888Z","load_balancing_strategy":"primary","db_duration_s":0.018031,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 245.814583] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:46.964Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a7a430ad7e582c04ace26109","created_at":"2026-09-04T07:41:59.659Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-5d3b47f23f9b4189","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:59.663Z","job_size_bytes":65,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a7a430ad7e582c04ace26109: start","job_status":"start","queue_duration_s":47.300248,"scheduling_latency_s":47.300297} gitlab # [ 245.981179] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:47.130Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a7a430ad7e582c04ace26109","created_at":"2026-09-04T07:41:59.659Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-5d3b47f23f9b4189","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:59.663Z","job_size_bytes":65,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a7a430ad7e582c04ace26109: done: 0.167231 sec","job_status":"done","queue_duration_s":47.300248,"scheduling_latency_s":47.300297,"redis_calls":21,"redis_duration_s":0.005996,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002605,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001756,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000274896,"duration_s":0.167231,"completed_at":"2026-09-04T07:42:47.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032762,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.983312] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:47.132Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f7628edd2f3421aee44db2dc","created_at":"2026-09-04T07:41:59.777Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-5d3b47f23f9b4189","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:59.782Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f7628edd2f3421aee44db2dc: start","job_status":"start","queue_duration_s":47.35019,"scheduling_latency_s":47.350204} gitlab # [ 246.229512] gitaly[907]: time="2026-09-04T07:42:47.378Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:47.377" grpc.time_ms=1.05 pid=907 span.kind=server system=grpc gitlab # [ 246.289771] gitaly[907]: time="2026-09-04T07:42:47.439Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:47.439" grpc.time_ms=0.61 pid=907 span.kind=server system=grpc gitlab # [ 246.335788] gitaly[907]: time="2026-09-04T07:42:47.485Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:47.485" grpc.time_ms=0.281 pid=907 span.kind=server system=grpc gitlab # [ 246.364752] gitaly[907]: time="2026-09-04T07:42:47.514Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 diskcache=3d4f98ef-2c9a-4a1f-a83b-e4b6771ccad4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:17.140" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:47.341" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.381581] gitaly[907]: time="2026-09-04T07:42:47.531Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=190 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7398 command.oublock=0 command.real_time_ms=165 command.spawn_token_fork_ms=0 command.system_time_ms=141 command.user_time_ms=49 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:17.140" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:47.341" grpc.time_ms=173.366 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.510934] gitaly[907]: time="2026-09-04T07:42:47.660Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:43:17.458" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:47.659" grpc.time_ms=1.224 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.576238] gitaly[907]: time="2026-09-04T07:42:47.726Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1MHJ962CJGQDFMMKR43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:17.524" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:47.725" grpc.time_ms=1.023 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 246.622612] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:47.771Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f7628edd2f3421aee44db2dc","created_at":"2026-09-04T07:41:59.777Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-5d3b47f23f9b4189","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:59.782Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2622,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f7628edd2f3421aee44db2dc: rescheduled"} gitlab # [ 246.635899] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:47.785Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f7628edd2f3421aee44db2dc","created_at":"2026-09-04T07:41:59.777Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-5d3b47f23f9b4189","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:59.782Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f7628edd2f3421aee44db2dc: done: 0.65308 sec","job_status":"done","queue_duration_s":47.35019,"scheduling_latency_s":47.350204,"gitaly_calls":3,"gitaly_duration_s":0.228644,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.030966999999999998,"redis_read_bytes":460,"redis_write_bytes":29295,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001381,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001495,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010712,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.005286,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15582,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007047,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000492,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000736,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002437,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.165,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.018,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.134,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.228041,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.500656089,"duration_s":0.65308,"completed_at":"2026-09-04T07:42:47.785Z","load_balancing_strategy":"primary","db_duration_s":0.177808,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 246.668492] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:47.787Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0ffbe21bac32f8e9be026bc462d5eaed72c6191f b6d0f44d48756a4aa0c96dbc78c409b765d49176 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"677ea555e0c45b2038624016","created_at":"2026-09-04T07:41:59.808Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-998e927a99174976","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:59.809Z","job_size_bytes":185,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-677ea555e0c45b2038624016: start","job_status":"start","queue_duration_s":47.978002,"scheduling_latency_s":47.97805} gitlab # [ 246.684805] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:47.806Z","message":"changes: \"0ffbe21bac32f8e9be026bc462d5eaed72c6191f b6d0f44d48756a4aa0c96dbc78c409b765d49176 refs/heads/master\\n\""} gitlab # [ 246.687289] nixbot[2616]: INFO: ::ffff:127.0.0.1:47538 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.10 seconds) gitlab # [ 246.694940] gitaly[907]: time="2026-09-04T07:42:47.845Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:57.183" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:47.834" grpc.time_ms=10.846 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.705447] gitaly[907]: time="2026-09-04T07:42:47.855Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:57.200" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:47.850" grpc.time_ms=4.449 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.745543] gitaly[907]: time="2026-09-04T07:42:47.876Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T07:42:57.221" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:47.871" grpc.time_ms=4.607 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.746437] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:47.859Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a02a2f508396c95705566f60","created_at":"2026-09-04T07:42:47.857Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-27d53fdc5a5e4a86","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"c9f5c4a51bf4147a2d309b32","job_size_bytes":46,"pid":2622,"job_status":"deduplicated","message":"ProjectCacheWorker JID-a02a2f508396c95705566f60: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 246.747201] gitaly[907]: time="2026-09-04T07:42:47.885Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-04T07:43:17.679" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:47.879" grpc.time_ms=5.226 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.751432] gitaly[907]: time="2026-09-04T07:42:47.896Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T07:42:57.243" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T07:42:47.893" grpc.time_ms=2.83 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.793947] gitaly[907]: time="2026-09-04T07:42:47.907Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:57.252" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:47.903" grpc.time_ms=4.06 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.815883] gitaly[907]: time="2026-09-04T07:42:47.966Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T07:42:57.028" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:47.948" grpc.time_ms=17.333 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.841187] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:47.991Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0ffbe21bac32f8e9be026bc462d5eaed72c6191f b6d0f44d48756a4aa0c96dbc78c409b765d49176 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"677ea555e0c45b2038624016","created_at":"2026-09-04T07:41:59.808Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-998e927a99174976","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:41:59.809Z","job_size_bytes":185,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-677ea555e0c45b2038624016: done: 0.20348 sec","job_status":"done","queue_duration_s":47.978002,"scheduling_latency_s":47.97805,"gitaly_calls":7,"gitaly_duration_s":0.076075,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.020624,"redis_read_bytes":501,"redis_write_bytes":11941,"redis_cache_calls":9,"redis_cache_duration_s":0.001206,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000566,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5718,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001783,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010649,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.00642,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001250717,"exclusive_lock_hold_duration_s":0.027383089,"duration_s":0.20348,"completed_at":"2026-09-04T07:42:47.991Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015793,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 246.887070] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.036Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"c9f5c4a51bf4147a2d309b32","created_at":"2026-09-04T07:42:45.943Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-e201e9c6fe504922","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:45.956Z","job_size_bytes":46,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-c9f5c4a51bf4147a2d309b32: start","job_status":"start","queue_duration_s":2.080086,"scheduling_latency_s":2.080129} gitlab # [ 246.957035] gitaly[907]: time="2026-09-04T07:42:48.107Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-04T13:42:48.103" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:48.104" grpc.time_ms=2.354 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.973821] gitaly[907]: time="2026-09-04T07:42:48.123Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T07:43:18.014" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:48.115" grpc.time_ms=8.549 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.999062] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.148Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"c9f5c4a51bf4147a2d309b32","created_at":"2026-09-04T07:42:45.943Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-e201e9c6fe504922","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:45.956Z","job_size_bytes":46,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-c9f5c4a51bf4147a2d309b32: done: 0.112145 sec","job_status":"done","queue_duration_s":2.080086,"scheduling_latency_s":2.080129,"gitaly_calls":2,"gitaly_duration_s":0.015784,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006513,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.0012,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000506,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002639,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000654,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000251429,"duration_s":0.112145,"completed_at":"2026-09-04T07:42:48.148Z","load_balancing_strategy":"primary","db_duration_s":0.013537,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.003087] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.150Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"fcc8bb07fb57f050e60619fb","created_at":"2026-09-04T07:42:45.968Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-e201e9c6fe504922","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:45.972Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-fcc8bb07fb57f050e60619fb: start","job_status":"start","queue_duration_s":2.17813,"scheduling_latency_s":2.178146} gitlab # [ 247.042956] gitaly[907]: time="2026-09-04T07:42:48.193Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT diskcache=e01542e9-2019-457e-aa9f-d07d4d26a70f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:42:48.166" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:48.167" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.043838] gitaly[907]: time="2026-09-04T07:42:48.193Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1279 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:42:48.166" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:48.167" grpc.time_ms=26.041 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.081048] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.230Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"fcc8bb07fb57f050e60619fb","created_at":"2026-09-04T07:42:45.968Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-e201e9c6fe504922","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:45.972Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-fcc8bb07fb57f050e60619fb: done: 0.080717 sec","job_status":"done","queue_duration_s":2.17813,"scheduling_latency_s":2.178146,"gitaly_calls":1,"gitaly_duration_s":0.028337,"redis_calls":15,"redis_duration_s":0.003435,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000454,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001113,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000719,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001149,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.019,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.061703093,"duration_s":0.080717,"completed_at":"2026-09-04T07:42:48.230Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.119670] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.232Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"da7349dc8698ec75e3a5cdaf","created_at":"2026-09-04T07:42:46.137Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-e201e9c6fe504922","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:46.138Z","job_size_bytes":23,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-da7349dc8698ec75e3a5cdaf: start","job_status":"start","queue_duration_s":2.093202,"scheduling_latency_s":2.093217} gitlab # [ 247.120529] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.261Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"da7349dc8698ec75e3a5cdaf","created_at":"2026-09-04T07:42:46.137Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-e201e9c6fe504922","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:46.138Z","job_size_bytes":23,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-da7349dc8698ec75e3a5cdaf: done: 0.029294 sec","job_status":"done","queue_duration_s":2.093202,"scheduling_latency_s":2.093217,"gitaly_calls":1,"gitaly_duration_s":0.008827,"redis_calls":16,"redis_duration_s":0.002148,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000191,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.000854,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000375,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029294,"completed_at":"2026-09-04T07:42:48.261Z","load_balancing_strategy":"primary","db_duration_s":0.001455,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.166700] gitaly[907]: time="2026-09-04T07:42:48.255Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=657 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T07:43:18.148" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:48.248" grpc.time_ms=7.251 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.167513] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.262Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"df63501abd2061d59059d9ab","created_at":"2026-09-04T07:42:46.539Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-e201e9c6fe504922","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c18625cf7fa31b72de535c307e3bf12cb42481b7bd4107e624ef04f9f818aade","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:46.544Z","job_size_bytes":467,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-df63501abd2061d59059d9ab: start","job_status":"start","queue_duration_s":1.717747,"scheduling_latency_s":1.717762} gitlab # [ 247.168172] gitaly[907]: time="2026-09-04T07:42:48.279Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:18.178" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:48.279" grpc.time_ms=0.683 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.174513] gitaly[907]: time="2026-09-04T07:42:48.288Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:42:58.251" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:48.281" grpc.time_ms=6.727 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.221838] gitaly[907]: time="2026-09-04T07:42:48.362Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:43:18.261" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:48.361" grpc.time_ms=0.895 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.222690] gitaly[907]: time="2026-09-04T07:42:48.367Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=42 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T07:43:18.264" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:48.365" grpc.time_ms=1.705 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.278415] gitaly[907]: time="2026-09-04T07:42:48.427Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:58.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:48.419" grpc.time_ms=8.07 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.636386] gitaly[907]: time="2026-09-04T07:42:48.786Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:43:18.667" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:48.768" grpc.time_ms=17.881 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.649485] gitaly[907]: time="2026-09-04T07:42:48.799Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNVWYH0XRG1FVWMG6ASPHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T07:43:18.689" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:48.789" grpc.time_ms=10.083 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.684146] sidekiq-cluster[2622]: {"severity":"WARN","time":"2026-09-04T07:42:48.833Z","class":"CreatePipelineWorker","correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"0ffbe21bac32f8e9be026bc462d5eaed72c6191f","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"0ffbe21bac32f8e9be026bc462d5eaed72c6191f","ref":"refs/heads/master"},"retry":0} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 247.693664] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.843Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"df63501abd2061d59059d9ab","created_at":"2026-09-04T07:42:46.539Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-e201e9c6fe504922","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c18625cf7fa31b72de535c307e3bf12cb42481b7bd4107e624ef04f9f818aade","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:46.544Z","job_size_bytes":467,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-df63501abd2061d59059d9ab: done: 0.580861 sec","job_status":"done","queue_duration_s":1.717747,"scheduling_latency_s":1.717762,"gitaly_calls":7,"gitaly_duration_s":0.059407,"redis_calls":51,"redis_duration_s":0.008564,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000551,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.0038,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001908,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.46611,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000455365,"duration_s":0.580861,"completed_at":"2026-09-04T07:42:48.843Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044588,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.739124] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.845Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"3385568d-b0cf-4e51-a0bc-8adfa4c0c07c\"}"],"class":"WebHookWorker","jid":"c94f143bd8190a39df9855b8","created_at":"2026-09-04T07:42:46.632Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-e201e9c6fe504922","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5dd7db53f2a4fa38933c751977a190e595704342c2cfd22783b84ee32f2c7463","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:46.636Z","job_size_bytes":1751,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c94f143bd8190a39df9855b8: start","job_status":"start","queue_duration_s":2.208817,"scheduling_latency_s":2.208844} gitlab # [ 247.788033] nixbot[2616]: INFO: ::ffff:127.0.0.1:47556 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.05 seconds) gitlab # [ 247.790664] nixbot[2616]: INFO: ::ffff:127.0.0.1:47542 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 247.805234] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.954Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"3385568d-b0cf-4e51-a0bc-8adfa4c0c07c\"}"],"class":"WebHookWorker","jid":"c94f143bd8190a39df9855b8","created_at":"2026-09-04T07:42:46.632Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-e201e9c6fe504922","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5dd7db53f2a4fa38933c751977a190e595704342c2cfd22783b84ee32f2c7463","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:46.636Z","job_size_bytes":1751,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c94f143bd8190a39df9855b8: done: 0.109559 sec","job_status":"done","queue_duration_s":2.208817,"scheduling_latency_s":2.208844,"redis_calls":19,"redis_duration_s":0.003568,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000764,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000332,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00154,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.032972067999992305,"cpu_s":0.064208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277689,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.109559,"completed_at":"2026-09-04T07:42:48.954Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.845758] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:48.956Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"eb37caff34294e481bd061d0","created_at":"2026-09-04T07:42:47.330Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.333Z","job_size_bytes":23,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-eb37caff34294e481bd061d0: start","job_status":"start","queue_duration_s":1.622512,"scheduling_latency_s":1.622528} gitlab # [ 247.862546] gitaly[907]: time="2026-09-04T07:42:49.011Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXJ3YV6VC218X6ACEN5J0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:49.004" grpc.time_ms=7.643 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.863546] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 54 gitlab # [ 247.878841] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.028Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"eb37caff34294e481bd061d0","created_at":"2026-09-04T07:42:47.330Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.333Z","job_size_bytes":23,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-eb37caff34294e481bd061d0: done: 0.072415 sec","job_status":"done","queue_duration_s":1.622512,"scheduling_latency_s":1.622528,"redis_calls":10,"redis_duration_s":0.0031190000000000002,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0004,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000256458,"duration_s":0.072415,"completed_at":"2026-09-04T07:42:49.028Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01235,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.899126] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.030Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ab1499eac644b32060c5237b","created_at":"2026-09-04T07:42:47.536Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.540Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ab1499eac644b32060c5237b: start","job_status":"start","queue_duration_s":1.489319,"scheduling_latency_s":1.489333} gitlab # [ 247.905066] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.055Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ab1499eac644b32060c5237b","created_at":"2026-09-04T07:42:47.536Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.540Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ab1499eac644b32060c5237b: done: 0.025029 sec","job_status":"done","queue_duration_s":1.489319,"scheduling_latency_s":1.489333,"redis_calls":10,"redis_duration_s":0.001326,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210083,"duration_s":0.025029,"completed_at":"2026-09-04T07:42:49.054Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.971985] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.121Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"81b858d839d6f660d43fe6f1","created_at":"2026-09-04T07:42:47.550Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.556Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-81b858d839d6f660d43fe6f1: start","job_status":"start","queue_duration_s":1.564817,"scheduling_latency_s":1.564847} gitlab # [ 247.989432] gitaly[907]: time="2026-09-04T07:42:49.139Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXJ5QNR25SFFVNY5MH006 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:49.058" pid=907 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 247.998220] gitaly[907]: time="2026-09-04T07:42:49.139Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=79 command.spawn_token_fork_ms=61 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXJ5QNR25SFFVNY5MH006 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:49.058" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.998527] gitlab-workhorse[827]: time="2026-09-04T07:42:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 247.998946] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 124 gitlab # [ 247.999566] gitaly[907]: time="2026-09-04T07:42:49.139Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=79 command.spawn_token_fork_ms=61 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXJ5QNR25SFFVNY5MH006 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:49.058" grpc.time_ms=81.604 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 248.013066] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.162Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"81b858d839d6f660d43fe6f1","created_at":"2026-09-04T07:42:47.550Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.556Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-81b858d839d6f660d43fe6f1: done: 0.041533 sec","job_status":"done","queue_duration_s":1.564817,"scheduling_latency_s":1.564847,"redis_calls":10,"redis_duration_s":0.001863,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000329,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000454,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000445866,"duration_s":0.041533,"completed_at":"2026-09-04T07:42:49.162Z","load_balancing_strategy":"primary","db_duration_s":0.016361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.025267] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.164Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9a87acfbbf07d6c089150eee","created_at":"2026-09-04T07:42:47.573Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.579Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9a87acfbbf07d6c089150eee: start","job_status":"start","queue_duration_s":1.584801,"scheduling_latency_s":1.584816} gitlab # [ 248.062741] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.190Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9a87acfbbf07d6c089150eee","created_at":"2026-09-04T07:42:47.573Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.579Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9a87acfbbf07d6c089150eee: done: 0.025868 sec","job_status":"done","queue_duration_s":1.584801,"scheduling_latency_s":1.584816,"redis_calls":13,"redis_duration_s":0.00218,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000353,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000505,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000256178,"duration_s":0.025868,"completed_at":"2026-09-04T07:42:49.190Z","load_balancing_strategy":"primary","db_duration_s":0.004885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.101139] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.191Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"accd05cffa209f20e5d62e87","created_at":"2026-09-04T07:42:47.580Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.585Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-accd05cffa209f20e5d62e87: start","job_status":"start","queue_duration_s":1.605302,"scheduling_latency_s":1.605316} gitlab # [ 248.101630] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.212Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"accd05cffa209f20e5d62e87","created_at":"2026-09-04T07:42:47.580Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.585Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-accd05cffa209f20e5d62e87: done: 0.021319 sec","job_status":"done","queue_duration_s":1.605302,"scheduling_latency_s":1.605316,"redis_calls":10,"redis_duration_s":0.001665,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000332,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257016,"duration_s":0.021319,"completed_at":"2026-09-04T07:42:49.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003933,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.146692] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.213Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c0de7b6cee6c319ab9d30ad4","created_at":"2026-09-04T07:42:47.586Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.592Z","job_size_bytes":19,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c0de7b6cee6c319ab9d30ad4: start","job_status":"start","queue_duration_s":1.621059,"scheduling_latency_s":1.621072} gitlab # [ 248.147571] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.236Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c0de7b6cee6c319ab9d30ad4","created_at":"2026-09-04T07:42:47.586Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.592Z","job_size_bytes":19,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c0de7b6cee6c319ab9d30ad4: done: 0.022679 sec","job_status":"done","queue_duration_s":1.621059,"scheduling_latency_s":1.621072,"redis_calls":11,"redis_duration_s":0.0020959999999999998,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000371,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001354,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000371,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000283555,"duration_s":0.022679,"completed_at":"2026-09-04T07:42:49.236Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.194854] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.238Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dd7d304d85a3d8c065bf3503","created_at":"2026-09-04T07:42:47.595Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.599Z","job_size_bytes":66,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dd7d304d85a3d8c065bf3503: start","job_status":"start","queue_duration_s":1.638154,"scheduling_latency_s":1.63817} gitlab # [ 248.198782] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.261Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dd7d304d85a3d8c065bf3503","created_at":"2026-09-04T07:42:47.595Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.599Z","job_size_bytes":66,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dd7d304d85a3d8c065bf3503: done: 0.023381 sec","job_status":"done","queue_duration_s":1.638154,"scheduling_latency_s":1.63817,"redis_calls":10,"redis_duration_s":0.0017059999999999998,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000318,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000338,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277409,"duration_s":0.023381,"completed_at":"2026-09-04T07:42:49.261Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.275781] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.262Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"4c1c2a2041b6f446c94a5414","created_at":"2026-09-04T07:42:47.600Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.605Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4c1c2a2041b6f446c94a5414: start","job_status":"start","queue_duration_s":1.656637,"scheduling_latency_s":1.656651} gitlab # [ 248.276613] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.288Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"4c1c2a2041b6f446c94a5414","created_at":"2026-09-04T07:42:47.600Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.605Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4c1c2a2041b6f446c94a5414: done: 0.025789 sec","job_status":"done","queue_duration_s":1.656637,"scheduling_latency_s":1.656651,"redis_calls":10,"redis_duration_s":0.0017460000000000002,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000394,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000332,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243606,"duration_s":0.025789,"completed_at":"2026-09-04T07:42:49.288Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.322912] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.289Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6a8e4f282aa666ececa250e9","created_at":"2026-09-04T07:42:47.615Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.621Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6a8e4f282aa666ececa250e9: start","job_status":"start","queue_duration_s":1.667893,"scheduling_latency_s":1.667906} gitlab # [ 248.323602] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.316Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6a8e4f282aa666ececa250e9","created_at":"2026-09-04T07:42:47.615Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.621Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6a8e4f282aa666ececa250e9: done: 0.0268 sec","job_status":"done","queue_duration_s":1.667893,"scheduling_latency_s":1.667906,"redis_calls":10,"redis_duration_s":0.001761,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000315,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000343,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029026,"duration_s":0.0268,"completed_at":"2026-09-04T07:42:49.316Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.374961] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.317Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b58a3a426c7f7f0a31f617db","created_at":"2026-09-04T07:42:47.622Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.627Z","job_size_bytes":6,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b58a3a426c7f7f0a31f617db: start","job_status":"start","queue_duration_s":1.689617,"scheduling_latency_s":1.689632} gitlab # [ 248.375712] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.333Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b58a3a426c7f7f0a31f617db","created_at":"2026-09-04T07:42:47.622Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.627Z","job_size_bytes":6,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b58a3a426c7f7f0a31f617db: done: 0.015997 sec","job_status":"done","queue_duration_s":1.689617,"scheduling_latency_s":1.689632,"redis_calls":10,"redis_duration_s":0.001763,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000396,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000255619,"duration_s":0.015997,"completed_at":"2026-09-04T07:42:49.333Z","load_balancing_strategy":"primary","db_duration_s":0.002008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.418320] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.334Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e2db9568af75ae1f64c9e1ef","created_at":"2026-09-04T07:42:47.628Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.633Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e2db9568af75ae1f64c9e1ef: start","job_status":"start","queue_duration_s":1.700572,"scheduling_latency_s":1.700585} gitlab # [ 248.419481] gitaly[907]: time="2026-09-04T07:42:49.491Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY diskcache=ecdb3280-ce31-4781-b8b6-5cef48eea3e8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:42:49.481" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:49.482" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.423133] gitaly[907]: time="2026-09-04T07:42:49.491Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:42:49.481" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:49.482" grpc.time_ms=9.124 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.435196] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.413Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e2db9568af75ae1f64c9e1ef","created_at":"2026-09-04T07:42:47.628Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.633Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e2db9568af75ae1f64c9e1ef: done: 0.079508 sec","job_status":"done","queue_duration_s":1.700572,"scheduling_latency_s":1.700585,"redis_calls":10,"redis_duration_s":0.001602,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00020226,"duration_s":0.079508,"completed_at":"2026-09-04T07:42:49.413Z","load_balancing_strategy":"primary","db_duration_s":0.004281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.480175] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.415Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"bb14cdc7a8c55ff334b4afad","created_at":"2026-09-04T07:42:47.641Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.646Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-bb14cdc7a8c55ff334b4afad: start","job_status":"start","queue_duration_s":1.768395,"scheduling_latency_s":1.768412} gitlab # [ 248.518420] gitaly[907]: time="2026-09-04T07:42:49.514Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:19.414" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:49.514" grpc.time_ms=0.421 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.519128] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.454Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"bb14cdc7a8c55ff334b4afad","created_at":"2026-09-04T07:42:47.641Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.646Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-bb14cdc7a8c55ff334b4afad: done: 0.039054 sec","job_status":"done","queue_duration_s":1.768395,"scheduling_latency_s":1.768412,"redis_calls":14,"redis_duration_s":0.002105,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000355352,"duration_s":0.039054,"completed_at":"2026-09-04T07:42:49.454Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.536573] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.455Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"bf32a381ce995225a3e1d054","created_at":"2026-09-04T07:42:47.772Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.774Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bf32a381ce995225a3e1d054: start","job_status":"start","queue_duration_s":1.680242,"scheduling_latency_s":1.680255} gitlab # [ 248.550613] gitaly[907]: time="2026-09-04T07:42:49.522Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:42:59.107" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:49.517" grpc.time_ms=5 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.599988] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.470Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"bf32a381ce995225a3e1d054","created_at":"2026-09-04T07:42:47.772Z","trace_propagation_headers":{"sentry-trace":"6cb46e40c3fa4c1fa5381defb9920665-e654aca174af4962","baggage":"sentry-trace_id=6cb46e40c3fa4c1fa5381defb9920665,sentry-release=Unknown"},"correlation_id":"01M1NNW1MHJ962CJGQDFMMKR43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.774Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bf32a381ce995225a3e1d054: done: 0.015388 sec","job_status":"done","queue_duration_s":1.680242,"scheduling_latency_s":1.680255,"redis_calls":8,"redis_duration_s":0.000986,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015388,"completed_at":"2026-09-04T07:42:49.470Z","load_balancing_strategy":"primary","db_duration_s":0.00214,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.600977] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.471Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7ba6533da15b53c67b28bd0a","created_at":"2026-09-04T07:42:47.865Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-27d53fdc5a5e4a86","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"fcc8bb07fb57f050e60619fb","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.867Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7ba6533da15b53c67b28bd0a: start","job_status":"start","queue_duration_s":1.603933,"scheduling_latency_s":1.603946} gitlab # [ 248.614752] nixbot[2616]: {"ts": "2026-09-04T07:42:49.726Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 248.616933] gitaly[907]: time="2026-09-04T07:42:49.541Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:43:19.440" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:49.541" grpc.time_ms=0.609 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.663703] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.500Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7ba6533da15b53c67b28bd0a","created_at":"2026-09-04T07:42:47.865Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-27d53fdc5a5e4a86","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"fcc8bb07fb57f050e60619fb","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.867Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7ba6533da15b53c67b28bd0a: done: 0.029114 sec","job_status":"done","queue_duration_s":1.603933,"scheduling_latency_s":1.603946,"gitaly_calls":1,"gitaly_duration_s":0.010754,"redis_calls":12,"redis_duration_s":0.0016510000000000001,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000349,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000612,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.018566326,"duration_s":0.029114,"completed_at":"2026-09-04T07:42:49.500Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.669674] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.501Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b9a4ce547ff475d7e4714617","created_at":"2026-09-04T07:42:47.931Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-27d53fdc5a5e4a86","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:15caf963ce01c6fc68f1e8053bc4378ccd97c594edc85aaa4c3f0c09d0a8f84d","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.933Z","job_size_bytes":467,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b9a4ce547ff475d7e4714617: start","job_status":"start","queue_duration_s":1.568381,"scheduling_latency_s":1.568395} gitlab # [ 248.684565] gitaly[907]: time="2026-09-04T07:42:49.545Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=31 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T07:43:19.444" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:49.544" grpc.time_ms=1.247 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.698929] gitaly[907]: time="2026-09-04T07:42:49.566Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:59.151" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:49.561" grpc.time_ms=4.359 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.710662] gitaly[907]: time="2026-09-04T07:42:49.773Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:19.472" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:49.772" grpc.time_ms=0.565 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.759673] nixbot[2616]: {"ts": "2026-09-04T07:42:49.858Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f \"HTTP/1.1 201 Created\""} gitlab # [ 248.760435] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 121 gitlab # [ 248.760918] gitaly[907]: time="2026-09-04T07:42:49.815Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:59.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:49.809" grpc.time_ms=5.684 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.761843] sidekiq-cluster[2622]: {"severity":"WARN","time":"2026-09-04T07:42:49.887Z","class":"CreatePipelineWorker","correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0ffbe21bac32f8e9be026bc462d5eaed72c6191f","after":"b6d0f44d48756a4aa0c96dbc78c409b765d49176","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"b6d0f44d48756a4aa0c96dbc78c409b765d49176","ref":"refs/heads/master"},"retry":0} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 248.762637] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b9a4ce547ff475d7e4714617","created_at":"2026-09-04T07:42:47.931Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-27d53fdc5a5e4a86","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:15caf963ce01c6fc68f1e8053bc4378ccd97c594edc85aaa4c3f0c09d0a8f84d","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.933Z","job_size_bytes":467,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b9a4ce547ff475d7e4714617: done: 0.39079 sec","job_status":"done","queue_duration_s":1.568381,"scheduling_latency_s":1.568395,"gitaly_calls":7,"gitaly_duration_s":0.038177,"redis_calls":33,"redis_duration_s":0.003679,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000369,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001435,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000665,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.336623,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.39079,"completed_at":"2026-09-04T07:42:49.892Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011216,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.804864] gitaly[907]: time="2026-09-04T07:42:49.870Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:43:19.761" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:49.862" grpc.time_ms=8.563 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.805736] nixbot[2616]: INFO: ::ffff:127.0.0.1:47572 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 248.807631] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.893Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"82407775-aa12-4121-bb45-4d164a79a2de\"}"],"class":"WebHookWorker","jid":"c04e2e859a007319cd7fcb39","created_at":"2026-09-04T07:42:47.940Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-27d53fdc5a5e4a86","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7c980e812980f5e5f595bdd2654703b6f4b20ad4e1f8debc8e10df159f46dcb7","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.941Z","job_size_bytes":1749,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c04e2e859a007319cd7fcb39: start","job_status":"start","queue_duration_s":1.951519,"scheduling_latency_s":1.951538} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.08 seconds) gitlab # [ 248.819205] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.921Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"82407775-aa12-4121-bb45-4d164a79a2de\"}"],"class":"WebHookWorker","jid":"c04e2e859a007319cd7fcb39","created_at":"2026-09-04T07:42:47.940Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-27d53fdc5a5e4a86","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7c980e812980f5e5f595bdd2654703b6f4b20ad4e1f8debc8e10df159f46dcb7","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:47.941Z","job_size_bytes":1749,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c04e2e859a007319cd7fcb39: done: 0.028039 sec","job_status":"done","queue_duration_s":1.951519,"scheduling_latency_s":1.951538,"redis_calls":14,"redis_duration_s":0.0021650000000000003,"redis_read_bytes":25,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000285,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001154,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000726,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006957307999982731,"cpu_s":0.015394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.028039,"completed_at":"2026-09-04T07:42:49.921Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001141,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.861035] gitaly[907]: time="2026-09-04T07:42:49.879Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNW1KKQZGN4FA4EH395DGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T07:43:19.772" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:49.872" grpc.time_ms=6.842 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.906919] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 54 gitlab # [ 248.907510] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 148 gitlab # [ 248.910514] gitlab-workhorse[827]: time="2026-09-04T07:42:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 248.910992] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 57 gitlab # [ 248.913496] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.923Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"9f650e8228fd353fe710d8c4","created_at":"2026-09-04T07:42:48.135Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-b35501189d044179","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:48.140Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-9f650e8228fd353fe710d8c4: start","job_status":"start","queue_duration_s":1.782409,"scheduling_latency_s":1.782427} gitlab # [ 248.914135] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.967Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"9f650e8228fd353fe710d8c4","created_at":"2026-09-04T07:42:48.135Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-b35501189d044179","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:48.140Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-9f650e8228fd353fe710d8c4: done: 0.044215 sec","job_status":"done","queue_duration_s":1.782409,"scheduling_latency_s":1.782427,"redis_calls":19,"redis_duration_s":0.009473,"redis_read_bytes":21,"redis_write_bytes":4284,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001977,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.002141,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2255,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004162,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.009643404,"duration_s":0.044215,"completed_at":"2026-09-04T07:42:49.967Z","load_balancing_strategy":"primary","db_duration_s":0.004566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.937642] gitaly[907]: time="2026-09-04T07:42:49.903Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXK05BB5SEDQV9NQYGN51 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:19.602" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:49.902" grpc.time_ms=0.645 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.952760] nixbot[2616]: {"ts": "2026-09-04T07:42:50.011Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f \"HTTP/1.1 201 Created\""} gitlab # [ 248.953528] nixbot[2616]: INFO: ::ffff:127.0.0.1:47586 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab # [ 248.954089] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:49.969Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c94f143bd8190a39df9855b8"],"class":"WebHooks::LogExecutionWorker","jid":"fd7b836ba424815f6ee4a7f2","created_at":"2026-09-04T07:42:48.944Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-0063929b884e4579","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:540c29256eef64810ddbec8cf5233f9f22e5278db1871f929f03d34d33b93967","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:48.949Z","job_size_bytes":2593,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-fd7b836ba424815f6ee4a7f2: start","job_status":"start","queue_duration_s":1.019507,"scheduling_latency_s":1.019524} gitlab # [ 248.967107] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.017Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c94f143bd8190a39df9855b8"],"class":"WebHooks::LogExecutionWorker","jid":"fd7b836ba424815f6ee4a7f2","created_at":"2026-09-04T07:42:48.944Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-0063929b884e4579","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:540c29256eef64810ddbec8cf5233f9f22e5278db1871f929f03d34d33b93967","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:48.949Z","job_size_bytes":2593,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-fd7b836ba424815f6ee4a7f2: done: 0.048376 sec","job_status":"done","queue_duration_s":1.019507,"scheduling_latency_s":1.019524,"redis_calls":10,"redis_duration_s":0.007906,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000887263,"duration_s":0.048376,"completed_at":"2026-09-04T07:42:50.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.008977] gitaly[907]: time="2026-09-04T07:42:49.944Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXK05BB5SEDQV9NQYGN51 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:59.036" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:49.937" grpc.time_ms=7.716 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.054812] nixbot[2616]: {"ts": "2026-09-04T07:42:50.148Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f \"HTTP/1.1 201 Created\""} gitlab # [ 249.055604] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.019Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"70558cae37ce9761bf191f08","created_at":"2026-09-04T07:42:49.842Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-1aa01971e0c945bc","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:49.845Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-70558cae37ce9761bf191f08: start","job_status":"start","queue_duration_s":0.173491,"scheduling_latency_s":0.173508} gitlab # [ 249.056539] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.144Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f7b6c8eb4346db6df841f755","created_at":"2026-09-04T07:42:50.142Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-e1fa35fed4a24f10","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"70558cae37ce9761bf191f08","job_size_bytes":3,"pid":2622,"job_status":"deduplicated","message":"PipelineProcessWorker JID-f7b6c8eb4346db6df841f755: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 249.057569] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.146Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"70558cae37ce9761bf191f08","created_at":"2026-09-04T07:42:49.842Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-1aa01971e0c945bc","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:49.845Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2622,"job_status":"rescheduled","message":"PipelineProcessWorker JID-70558cae37ce9761bf191f08: rescheduled"} gitlab # [ 249.064623] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0ffbe21bac32f8e9be026bc462d5eaed72c6191f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 131 gitlab # [ 249.066876] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 65 gitlab # [ 249.068839] gitlab-workhorse[827]: time="2026-09-04T07:42:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 249.070729] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 51 gitlab # [ 249.072541] gitaly[907]: time="2026-09-04T07:42:49.992Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXK2KYH82Z1B0GRMRBX0T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:49.981" grpc.time_ms=11.071 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 249.084810] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.152Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"70558cae37ce9761bf191f08","created_at":"2026-09-04T07:42:49.842Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-1aa01971e0c945bc","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:49.845Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-70558cae37ce9761bf191f08: done: 0.133027 sec","job_status":"done","queue_duration_s":0.173491,"scheduling_latency_s":0.173508,"gitaly_calls":2,"gitaly_duration_s":0.015874,"redis_calls":37,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.023673,"redis_read_bytes":139,"redis_write_bytes":6671,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.005276,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000434,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_calls":4,"redis_queues_duration_s":0.001575,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2221,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.003878,"redis_queues_metadata_read_bytes":89,"redis_queues_metadata_write_bytes":1432,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.005038,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000177,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002019,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063997,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.103647809,"duration_s":0.133027,"completed_at":"2026-09-04T07:42:50.152Z","load_balancing_strategy":"primary","db_duration_s":0.03256,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.131877] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.157Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c04e2e859a007319cd7fcb39"],"class":"WebHooks::LogExecutionWorker","jid":"a313e462ce35e7334cf2e7f1","created_at":"2026-09-04T07:42:49.915Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-8a85f9ad88884535","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b5958f70107fedb47feff9d86ebb819fb05ca4241efb27a736c12cabf697eec4","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:49.916Z","job_size_bytes":2592,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a313e462ce35e7334cf2e7f1: start","job_status":"start","queue_duration_s":0.240192,"scheduling_latency_s":0.240209} gitlab # [ 249.175793] gitaly[907]: time="2026-09-04T07:42:50.049Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXK4ZM31YPYMMKJEB228S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:20.047" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:50.048" grpc.time_ms=0.406 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.176643] gitaly[907]: time="2026-09-04T07:42:50.050Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXK4AHZTTXD5X5AEPRFET grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:50.040" pid=907 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 249.179139] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.179Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c04e2e859a007319cd7fcb39"],"class":"WebHooks::LogExecutionWorker","jid":"a313e462ce35e7334cf2e7f1","created_at":"2026-09-04T07:42:49.915Z","trace_propagation_headers":{"sentry-trace":"c1fbcf2a134c418faa68cdebc3c786dd-8a85f9ad88884535","baggage":"sentry-trace_id=c1fbcf2a134c418faa68cdebc3c786dd,sentry-release=Unknown"},"correlation_id":"01M1NNW1KKQZGN4FA4EH395DGY","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b5958f70107fedb47feff9d86ebb819fb05ca4241efb27a736c12cabf697eec4","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:49.916Z","job_size_bytes":2592,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a313e462ce35e7334cf2e7f1: done: 0.021947 sec","job_status":"done","queue_duration_s":0.240192,"scheduling_latency_s":0.240209,"redis_calls":7,"redis_duration_s":0.00186,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001485,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000375,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021947,"completed_at":"2026-09-04T07:42:50.179Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.233243] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.180Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6e0d51b21d114762723cd6de","created_at":"2026-09-04T07:42:49.949Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-dce77a89ced74e7c","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:49.954Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6e0d51b21d114762723cd6de: start","job_status":"start","queue_duration_s":0.225275,"scheduling_latency_s":0.225297} gitlab # [ 249.234025] gitaly[907]: time="2026-09-04T07:42:50.050Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXK4AHZTTXD5X5AEPRFET grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:50.040" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 249.235993] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.249Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6e0d51b21d114762723cd6de","created_at":"2026-09-04T07:42:49.949Z","trace_propagation_headers":{"sentry-trace":"ccba3f01dadf4b8d8934693383820a25-dce77a89ced74e7c","baggage":"sentry-trace_id=ccba3f01dadf4b8d8934693383820a25,sentry-release=Unknown"},"correlation_id":"01M1NNVWYH0XRG1FVWMG6ASPHT","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:49.954Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6e0d51b21d114762723cd6de: done: 0.069381 sec","job_status":"done","queue_duration_s":0.225275,"scheduling_latency_s":0.225297,"redis_calls":11,"redis_duration_s":0.008217,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.007647,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000296686,"duration_s":0.069381,"completed_at":"2026-09-04T07:42:50.249Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.298025] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.250Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"9363908f0198f6c937abf5b9","created_at":"2026-09-04T07:42:50.081Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-e1fa35fed4a24f10","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.083Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9363908f0198f6c937abf5b9: start","job_status":"start","queue_duration_s":0.166635,"scheduling_latency_s":0.166649} gitlab # [ 249.298736] gitaly[907]: time="2026-09-04T07:42:50.051Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXK4AHZTTXD5X5AEPRFET grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:50.040" grpc.time_ms=10.838 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 249.342775] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.274Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"9363908f0198f6c937abf5b9","created_at":"2026-09-04T07:42:50.081Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-e1fa35fed4a24f10","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.083Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9363908f0198f6c937abf5b9: done: 0.023617 sec","job_status":"done","queue_duration_s":0.166635,"scheduling_latency_s":0.166649,"redis_calls":7,"redis_duration_s":0.001348,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023617,"completed_at":"2026-09-04T07:42:50.274Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.343733] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.275Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"527aec9fb52a546213d61716","created_at":"2026-09-04T07:42:50.146Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-e1fa35fed4a24f10","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.147Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-527aec9fb52a546213d61716: start","job_status":"start","queue_duration_s":0.128769,"scheduling_latency_s":0.128784} gitlab # [ 249.391950] nixbot[2616]: {"ts": "2026-09-04T07:42:50.469Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b6d0f44d48756a4aa0c96dbc78c409b765d49176 \"HTTP/1.1 201 Created\""} gitlab # [ 249.392578] nixbot[2616]: {"ts": "2026-09-04T07:42:50.476Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-b6d0f44d4875-5"} gitlab # [ 249.393089] gitaly[907]: time="2026-09-04T07:42:50.107Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:43:20.106" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:50.106" grpc.time_ms=0.502 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.393753] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 232 gitlab # [ 249.394362] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.490Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"527aec9fb52a546213d61716","created_at":"2026-09-04T07:42:50.146Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-e1fa35fed4a24f10","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.147Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-527aec9fb52a546213d61716: done: 0.214369 sec","job_status":"done","queue_duration_s":0.128769,"scheduling_latency_s":0.128784,"gitaly_calls":3,"gitaly_duration_s":0.083244,"redis_calls":71,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012783000000000001,"redis_read_bytes":153,"redis_write_bytes":19878,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000604,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000593,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":23,"redis_queues_duration_s":0.003911,"redis_queues_read_bytes":27,"redis_queues_write_bytes":13380,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004734,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00019,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000497,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00165,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09296,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.186246017,"duration_s":0.214369,"completed_at":"2026-09-04T07:42:50.490Z","load_balancing_strategy":"primary","db_duration_s":0.028718,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.456977] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.491Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e76b8368e9a0baee6dbabc44","created_at":"2026-09-04T07:42:50.328Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.332Z","job_size_bytes":23,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e76b8368e9a0baee6dbabc44: start","job_status":"start","queue_duration_s":0.158894,"scheduling_latency_s":0.158909} gitlab # [ 249.457907] gitaly[907]: time="2026-09-04T07:42:50.110Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXK4ZM31YPYMMKJEB228S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:00.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:50.092" grpc.time_ms=17.271 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.458570] nixbot[2616]: {"ts": "2026-09-04T07:42:50.560Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-b6d0f44d4875-5", "argv0": "bwrap"} gitlab # [ 249.459093] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.519Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e76b8368e9a0baee6dbabc44","created_at":"2026-09-04T07:42:50.328Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.332Z","job_size_bytes":23,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e76b8368e9a0baee6dbabc44: done: 0.028251 sec","job_status":"done","queue_duration_s":0.158894,"scheduling_latency_s":0.158909,"redis_calls":7,"redis_duration_s":0.0009789999999999998,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028251,"completed_at":"2026-09-04T07:42:50.519Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005501,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.504768] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.520Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"31c964146e3016a8e4eff69e","created_at":"2026-09-04T07:42:50.405Z","trace_propagation_headers":{"sentry-trace":"96f8764bc07e44c9bab301e5314a891b-acd2b469bf3f4c2a","baggage":"sentry-trace_id=96f8764bc07e44c9bab301e5314a891b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXKBV74ZCHFWG36FQXS9E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.409Z","job_size_bytes":65,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-31c964146e3016a8e4eff69e: start","job_status":"start","queue_duration_s":0.110908,"scheduling_latency_s":0.110922} gitlab # [ 249.505584] gitaly[907]: time="2026-09-04T07:42:50.138Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:20.037" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:50.137" grpc.time_ms=0.398 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.514021] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.537Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"31c964146e3016a8e4eff69e","created_at":"2026-09-04T07:42:50.405Z","trace_propagation_headers":{"sentry-trace":"96f8764bc07e44c9bab301e5314a891b-acd2b469bf3f4c2a","baggage":"sentry-trace_id=96f8764bc07e44c9bab301e5314a891b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXKBV74ZCHFWG36FQXS9E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.409Z","job_size_bytes":65,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-31c964146e3016a8e4eff69e: done: 0.016611 sec","job_status":"done","queue_duration_s":0.110908,"scheduling_latency_s":0.110922,"redis_calls":7,"redis_duration_s":0.0009289999999999999,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016611,"completed_at":"2026-09-04T07:42:50.537Z","load_balancing_strategy":"primary","db_duration_s":0.002814,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.558543] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.538Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"386d3af94921a3bb777efb77","created_at":"2026-09-04T07:42:50.410Z","trace_propagation_headers":{"sentry-trace":"96f8764bc07e44c9bab301e5314a891b-acd2b469bf3f4c2a","baggage":"sentry-trace_id=96f8764bc07e44c9bab301e5314a891b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXKBV74ZCHFWG36FQXS9E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.413Z","job_size_bytes":65,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-386d3af94921a3bb777efb77: start","job_status":"start","queue_duration_s":0.124773,"scheduling_latency_s":0.124787} gitlab # [ 249.603969] gitaly[907]: time="2026-09-04T07:42:50.157Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXK7CKP60ZETGGC6604JD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:50.151" grpc.time_ms=6.053 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 249.604576] gitaly[907]: time="2026-09-04T07:42:50.211Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXK9GEX8HG2X5MWQ6KG63 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:50.201" pid=907 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 249.605268] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.580Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"386d3af94921a3bb777efb77","created_at":"2026-09-04T07:42:50.410Z","trace_propagation_headers":{"sentry-trace":"96f8764bc07e44c9bab301e5314a891b-acd2b469bf3f4c2a","baggage":"sentry-trace_id=96f8764bc07e44c9bab301e5314a891b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXKBV74ZCHFWG36FQXS9E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.413Z","job_size_bytes":65,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-386d3af94921a3bb777efb77: done: 0.042703 sec","job_status":"done","queue_duration_s":0.124773,"scheduling_latency_s":0.124787,"redis_calls":10,"redis_duration_s":0.008845,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.005119,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042703,"completed_at":"2026-09-04T07:42:50.580Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.654370] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.582Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0701a5dce692e52e9c765067","created_at":"2026-09-04T07:42:50.418Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.420Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0701a5dce692e52e9c765067: start","job_status":"start","queue_duration_s":0.161737,"scheduling_latency_s":0.161754} gitlab # [ 249.654996] gitaly[907]: time="2026-09-04T07:42:50.211Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXK9GEX8HG2X5MWQ6KG63 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:50.201" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 249.655620] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.598Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0701a5dce692e52e9c765067","created_at":"2026-09-04T07:42:50.418Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.420Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0701a5dce692e52e9c765067: done: 0.016344 sec","job_status":"done","queue_duration_s":0.161737,"scheduling_latency_s":0.161754,"redis_calls":7,"redis_duration_s":0.000945,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016344,"completed_at":"2026-09-04T07:42:50.598Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.708667] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.599Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c9d18dad72970dd1b69c8ddf","created_at":"2026-09-04T07:42:50.425Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.427Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c9d18dad72970dd1b69c8ddf: start","job_status":"start","queue_duration_s":0.171318,"scheduling_latency_s":0.171332} gitlab # [ 249.709308] gitaly[907]: time="2026-09-04T07:42:50.211Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXK9GEX8HG2X5MWQ6KG63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:50.201" grpc.time_ms=9.996 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 249.719596] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c9d18dad72970dd1b69c8ddf","created_at":"2026-09-04T07:42:50.425Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.427Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c9d18dad72970dd1b69c8ddf: done: 0.017316 sec","job_status":"done","queue_duration_s":0.171318,"scheduling_latency_s":0.171332,"redis_calls":7,"redis_duration_s":0.001102,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017316,"completed_at":"2026-09-04T07:42:50.616Z","load_balancing_strategy":"primary","db_duration_s":0.003623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.757601] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.617Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d62076aadc8fa16b1e9d99f5","created_at":"2026-09-04T07:42:50.434Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.436Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d62076aadc8fa16b1e9d99f5: start","job_status":"start","queue_duration_s":0.181147,"scheduling_latency_s":0.181162} gitlab # [ 249.771631] gitaly[907]: time="2026-09-04T07:42:50.272Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:20.271" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:50.271" grpc.time_ms=0.931 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.783255] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.634Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d62076aadc8fa16b1e9d99f5","created_at":"2026-09-04T07:42:50.434Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.436Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d62076aadc8fa16b1e9d99f5: done: 0.017511 sec","job_status":"done","queue_duration_s":0.181147,"scheduling_latency_s":0.181162,"redis_calls":10,"redis_duration_s":0.001387,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000391,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017511,"completed_at":"2026-09-04T07:42:50.634Z","load_balancing_strategy":"primary","db_duration_s":0.002875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176' gitlab # [ 249.830767] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.635Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"53e3b4a918eaededde89cd21","created_at":"2026-09-04T07:42:50.436Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.437Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-53e3b4a918eaededde89cd21: start","job_status":"start","queue_duration_s":0.19815,"scheduling_latency_s":0.198164} gitlab # [ 249.871840] gitaly[907]: time="2026-09-04T07:42:50.285Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:43:20.279" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:50.279" grpc.time_ms=6.133 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.872644] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.650Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"53e3b4a918eaededde89cd21","created_at":"2026-09-04T07:42:50.436Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.437Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-53e3b4a918eaededde89cd21: done: 0.014546 sec","job_status":"done","queue_duration_s":0.19815,"scheduling_latency_s":0.198164,"redis_calls":7,"redis_duration_s":0.00094,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014546,"completed_at":"2026-09-04T07:42:50.650Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002221,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.920642] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a7fb66ff6378d229eae3ac32","created_at":"2026-09-04T07:42:50.437Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.439Z","job_size_bytes":19,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a7fb66ff6378d229eae3ac32: start","job_status":"start","queue_duration_s":0.21187,"scheduling_latency_s":0.211884} gitlab # [ 249.921506] gitaly[907]: time="2026-09-04T07:42:50.296Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:00.221" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:50.291" grpc.time_ms=5.018 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.922121] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.665Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a7fb66ff6378d229eae3ac32","created_at":"2026-09-04T07:42:50.437Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.439Z","job_size_bytes":19,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a7fb66ff6378d229eae3ac32: done: 0.014601 sec","job_status":"done","queue_duration_s":0.21187,"scheduling_latency_s":0.211884,"redis_calls":8,"redis_duration_s":0.0011639999999999999,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014601,"completed_at":"2026-09-04T07:42:50.665Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.963549] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.666Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"323434102d74a89fe25a7464","created_at":"2026-09-04T07:42:50.439Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.440Z","job_size_bytes":66,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-323434102d74a89fe25a7464: start","job_status":"start","queue_duration_s":0.225807,"scheduling_latency_s":0.225822} gitlab # [ 249.964144] gitaly[907]: time="2026-09-04T07:42:50.316Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:43:00.246" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:50.316" grpc.time_ms=0.186 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.972290] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.679Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"323434102d74a89fe25a7464","created_at":"2026-09-04T07:42:50.439Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.440Z","job_size_bytes":66,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-323434102d74a89fe25a7464: done: 0.012619 sec","job_status":"done","queue_duration_s":0.225807,"scheduling_latency_s":0.225822,"redis_calls":7,"redis_duration_s":0.000913,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012619,"completed_at":"2026-09-04T07:42:50.679Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.011849] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.680Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f0af70651a7bb54e018c9b64","created_at":"2026-09-04T07:42:50.441Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.442Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f0af70651a7bb54e018c9b64: start","job_status":"start","queue_duration_s":0.237824,"scheduling_latency_s":0.237838} gitlab # [ 250.026470] gitaly[907]: time="2026-09-04T07:42:50.326Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:43:00.250" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:50.320" grpc.time_ms=5.807 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.069588] gitaly[907]: time="2026-09-04T07:42:50.357Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:50.356" grpc.time_ms=0.673 pid=907 span.kind=server system=grpc gitlab # [ 250.070222] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f0af70651a7bb54e018c9b64","created_at":"2026-09-04T07:42:50.441Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.442Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f0af70651a7bb54e018c9b64: done: 0.018964 sec","job_status":"done","queue_duration_s":0.237824,"scheduling_latency_s":0.237838,"redis_calls":7,"redis_duration_s":0.000889,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018964,"completed_at":"2026-09-04T07:42:50.699Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.118313] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.700Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"36b83ce69b036315d7efcf72","created_at":"2026-09-04T07:42:50.445Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.446Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-36b83ce69b036315d7efcf72: start","job_status":"start","queue_duration_s":0.253797,"scheduling_latency_s":0.253813} gitlab # [ 250.119045] gitaly[907]: time="2026-09-04T07:42:50.361Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:50.360" grpc.time_ms=0.45 pid=907 span.kind=server system=grpc gitlab # [ 250.119452] gitaly[907]: time="2026-09-04T07:42:50.374Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:50.374" grpc.time_ms=0.266 pid=907 span.kind=server system=grpc gitlab # [ 250.119955] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.715Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"36b83ce69b036315d7efcf72","created_at":"2026-09-04T07:42:50.445Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.446Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-36b83ce69b036315d7efcf72: done: 0.015004 sec","job_status":"done","queue_duration_s":0.253797,"scheduling_latency_s":0.253813,"redis_calls":7,"redis_duration_s":0.000936,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015004,"completed_at":"2026-09-04T07:42:50.715Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.160922] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"43ed3657aebf3471e6cf1d8a","created_at":"2026-09-04T07:42:50.446Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.447Z","job_size_bytes":6,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-43ed3657aebf3471e6cf1d8a: start","job_status":"start","queue_duration_s":0.268455,"scheduling_latency_s":0.268468} gitlab # [ 250.201293] gitaly[907]: time="2026-09-04T07:42:50.379Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:50.379" grpc.time_ms=0.238 pid=907 span.kind=server system=grpc gitlab # [ 250.201861] gitaly[907]: time="2026-09-04T07:42:50.393Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E diskcache=a1546142-6c46-4f89-bc77-9af01b462efc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:43:00.257" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:50.328" pid=907 ref=refs/keep-around/b6d0f44d48756a4aa0c96dbc78c409b765d49176 remote_ip="2001:db8:1::1" revision=b6d0f44d48756a4aa0c96dbc78c409b765d49176 span.kind=server system=grpc username=root gitlab # [ 250.202521] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.724Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"43ed3657aebf3471e6cf1d8a","created_at":"2026-09-04T07:42:50.446Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.447Z","job_size_bytes":6,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-43ed3657aebf3471e6cf1d8a: done: 0.008247 sec","job_status":"done","queue_duration_s":0.268455,"scheduling_latency_s":0.268468,"redis_calls":7,"redis_duration_s":0.000865,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00063,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008247,"completed_at":"2026-09-04T07:42:50.724Z","load_balancing_strategy":"primary","db_duration_s":0.000239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.244980] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.725Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f4c720327d64b36b10735166","created_at":"2026-09-04T07:42:50.448Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.450Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f4c720327d64b36b10735166: start","job_status":"start","queue_duration_s":0.274925,"scheduling_latency_s":0.274938} gitlab # [ 250.245620] gitaly[907]: time="2026-09-04T07:42:50.393Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=42 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5346 command.oublock=8 command.real_time_ms=58 command.spawn_token_fork_ms=7 command.system_time_ms=28 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:43:00.257" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:50.328" grpc.time_ms=65.494 pid=907 ref=refs/keep-around/b6d0f44d48756a4aa0c96dbc78c409b765d49176 remote_ip="2001:db8:1::1" revision=b6d0f44d48756a4aa0c96dbc78c409b765d49176 span.kind=server system=grpc username=root gitlab # [ 250.247077] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.738Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f4c720327d64b36b10735166","created_at":"2026-09-04T07:42:50.448Z","trace_propagation_headers":{"sentry-trace":"2ea92bc26ce040058118e2c422ec9c45-bf101ca5061540d7","baggage":"sentry-trace_id=2ea92bc26ce040058118e2c422ec9c45,sentry-release=Unknown"},"correlation_id":"01M1NNXJW7E9CR3VM5DSYXXAF1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.450Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f4c720327d64b36b10735166: done: 0.013041 sec","job_status":"done","queue_duration_s":0.274925,"scheduling_latency_s":0.274938,"redis_calls":7,"redis_duration_s":0.0009190000000000001,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013041,"completed_at":"2026-09-04T07:42:50.737Z","load_balancing_strategy":"primary","db_duration_s":0.001845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.295164] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.739Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cfb4a29dc6290ecaa68ad163","created_at":"2026-09-04T07:42:50.453Z","trace_propagation_headers":{"sentry-trace":"96f8764bc07e44c9bab301e5314a891b-acd2b469bf3f4c2a","baggage":"sentry-trace_id=96f8764bc07e44c9bab301e5314a891b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXKBV74ZCHFWG36FQXS9E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.455Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cfb4a29dc6290ecaa68ad163: start","job_status":"start","queue_duration_s":0.283267,"scheduling_latency_s":0.28328} gitlab # [ 250.297516] gitaly[907]: time="2026-09-04T07:42:50.398Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:20.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:50.396" grpc.time_ms=1.804 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.309087] gitaly[907]: time="2026-09-04T07:42:50.403Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:50.403" grpc.time_ms=0.273 pid=907 span.kind=server system=grpc gitlab # [ 250.317676] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.814Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cfb4a29dc6290ecaa68ad163","created_at":"2026-09-04T07:42:50.453Z","trace_propagation_headers":{"sentry-trace":"96f8764bc07e44c9bab301e5314a891b-acd2b469bf3f4c2a","baggage":"sentry-trace_id=96f8764bc07e44c9bab301e5314a891b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXKBV74ZCHFWG36FQXS9E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.455Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cfb4a29dc6290ecaa68ad163: done: 0.075302 sec","job_status":"done","queue_duration_s":0.283267,"scheduling_latency_s":0.28328,"gitaly_calls":2,"gitaly_duration_s":0.004346,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004178,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000677,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000639,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000209,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000142,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000283,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000568,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054507,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.057917976,"duration_s":0.075302,"completed_at":"2026-09-04T07:42:50.814Z","load_balancing_strategy":"primary","db_duration_s":0.016053,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 250.389736] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.815Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"361fbf87102c42aa5d629489","created_at":"2026-09-04T07:42:50.774Z","trace_propagation_headers":{"sentry-trace":"96f8764bc07e44c9bab301e5314a891b-6425b01bd7d14e75","baggage":"sentry-trace_id=96f8764bc07e44c9bab301e5314a891b,sentry-release=Unknown"},"correlation_id":"01M1NNXKBV74ZCHFWG36FQXS9E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.776Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-361fbf87102c42aa5d629489: start","job_status":"start","queue_duration_s":0.039178,"scheduling_latency_s":0.039193} gitlab # [ 250.390558] gitaly[907]: time="2026-09-04T07:42:50.414Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 diskcache=7e09f155-b770-4069-ba85-1fb89fbbe376 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:20.236" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:50.336" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.391218] gitaly[907]: time="2026-09-04T07:42:50.414Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=63 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7114 command.oublock=0 command.real_time_ms=71 command.spawn_token_fork_ms=0 command.system_time_ms=39 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:20.236" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:50.336" grpc.time_ms=77.39 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.397732] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:50.835Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"361fbf87102c42aa5d629489","created_at":"2026-09-04T07:42:50.774Z","trace_propagation_headers":{"sentry-trace":"96f8764bc07e44c9bab301e5314a891b-6425b01bd7d14e75","baggage":"sentry-trace_id=96f8764bc07e44c9bab301e5314a891b,sentry-release=Unknown"},"correlation_id":"01M1NNXKBV74ZCHFWG36FQXS9E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:50.776Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-361fbf87102c42aa5d629489: done: 0.019709 sec","job_status":"done","queue_duration_s":0.039178,"scheduling_latency_s":0.039193,"redis_calls":7,"redis_duration_s":0.0009350000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019709,"completed_at":"2026-09-04T07:42:50.834Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.470098] gitaly[907]: time="2026-09-04T07:42:50.459Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:43:20.358" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:50.458" grpc.time_ms=0.687 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.470731] gitaly[907]: time="2026-09-04T07:42:50.482Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXJW7E9CR3VM5DSYXXAF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:20.381" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:50.481" grpc.time_ms=0.532 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.471487] gitaly[907]: time="2026-09-04T07:42:50.786Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:43:20.685" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:50.785" grpc.time_ms=0.717 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.472147] gitaly[907]: time="2026-09-04T07:42:50.807Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXKBV74ZCHFWG36FQXS9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:20.706" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:50.806" grpc.time_ms=0.543 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.543628] nixbot[2616]: INFO: ::ffff:127.0.0.1:47598 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b6d0f44d48756a4aa0c96dbc78c409b765d49176', in 0.69 seconds) (finished: subtest: push delivers the webhook, in 52.65 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses gitlab # [ 250.578253] nix-daemon[2845]: accepted connection from pid 3431, user nixbot gitlab # [ 250.630464] gitaly[907]: time="2026-09-04T07:42:51.780Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXMTRZD5N87CCTGF9V4RM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:21.479" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:51.779" grpc.time_ms=0.663 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.662455] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 75 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses, in 0.11 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses gitlab # [ 251.794350] gitaly[907]: time="2026-09-04T07:42:52.943Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXNXK4WTE2N03BYN4142P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:22.641" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:52.942" grpc.time_ms=0.964 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.832460] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 130 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses, in 0.17 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses gitlab # [ 252.931408] gitaly[907]: time="2026-09-04T07:42:54.080Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXQ26137JPZRTDH4XSN6H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:24.078" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:54.079" grpc.time_ms=0.876 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 252.964850] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 91 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses, in 0.13 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses gitlab # [ 254.101038] gitaly[907]: time="2026-09-04T07:42:55.250Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXR5KPKKZCMV74VCT496A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:25.248" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:55.249" grpc.time_ms=0.975 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.164490] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 158 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses, in 0.20 seconds) gitlab # [ 255.143509] nix-daemon[2845]: accepted connection from pid 3468, user nixbot gitlab # [ 255.157062] nix-daemon[2845]: accepted connection from pid 3431, user nixbot gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses gitlab # [ 255.250246] gitaly[907]: time="2026-09-04T07:42:56.399Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:26.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:56.398" grpc.time_ms=0.908 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.277551] gitaly[907]: time="2026-09-04T07:42:56.420Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSB3HV3AJ7BS56W65BSG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:26.119" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:56.419" grpc.time_ms=0.885 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.297870] gitaly[907]: time="2026-09-04T07:42:56.433Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:06.038" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.428" grpc.time_ms=5.158 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.310607] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 93 gitlab # [ 255.313779] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.459Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ecc5446f677f6764b0336f44","created_at":"2026-09-04T07:42:56.454Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-db692ea49c474183","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.456Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ecc5446f677f6764b0336f44: start","job_status":"start","queue_duration_s":0.002973,"scheduling_latency_s":0.003006} gitlab # [ 255.328256] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 120 gitlab # [ 255.331069] nixbot[2616]: {"ts": "2026-09-04T07:42:56.472Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b6d0f44d48756a4aa0c96dbc78c409b765d49176 \"HTTP/1.1 201 Created\""} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses, in 0.16 seconds) gitlab # [ 255.356209] gitaly[907]: time="2026-09-04T07:42:56.506Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSETNTKPQAX7FB7SA0NB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:26.205" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:56.505" grpc.time_ms=0.484 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.380648] gitaly[907]: time="2026-09-04T07:42:56.530Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:56.530" grpc.time_ms=0.283 pid=907 span.kind=server system=grpc gitlab # [ 255.382976] gitaly[907]: time="2026-09-04T07:42:56.533Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSETNTKPQAX7FB7SA0NB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:06.136" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.527" grpc.time_ms=5.942 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.418578] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 93 gitlab # [ 255.419248] nixbot[2616]: {"ts": "2026-09-04T07:42:56.569Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b6d0f44d48756a4aa0c96dbc78c409b765d49176 \"HTTP/1.1 201 Created\""} gitlab # [ 255.426110] gitaly[907]: time="2026-09-04T07:42:56.576Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:56.575" grpc.time_ms=0.309 pid=907 span.kind=server system=grpc gitlab # [ 255.456749] gitaly[907]: time="2026-09-04T07:42:56.606Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:56.606" grpc.time_ms=0.307 pid=907 span.kind=server system=grpc gitlab # [ 255.466160] gitaly[907]: time="2026-09-04T07:42:56.616Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSJ499TJW3GHAYZGNEKD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:26.315" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:56.615" grpc.time_ms=0.657 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.478907] gitaly[907]: time="2026-09-04T07:42:56.629Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:26.409" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.510" operations="[repack_refs]" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.481340] gitaly[907]: time="2026-09-04T07:42:56.631Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:26.409" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.510" pid=907 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-04 07:41:53.176852483 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 255.487194] gitaly[907]: time="2026-09-04T07:42:56.637Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 diskcache=c6680488-6fb2-4939-8832-75417270f2de grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:26.409" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.510" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.488177] gitaly[907]: time="2026-09-04T07:42:56.638Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=115 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7937 command.oublock=0 command.real_time_ms=120 command.spawn_token_fork_ms=0 command.system_time_ms=84 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:26.409" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.510" grpc.time_ms=127.817 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.494966] gitaly[907]: time="2026-09-04T07:42:56.645Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:26.409" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.510" pid=907 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 255.495629] gitaly[907]: time="2026-09-04T07:42:56.645Z" level=info msg="optimized repository" clean_stale_data_time=13.314542ms clean_work_trees_time="89.956µs" commit_graph_time="3.352µs" correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.47µs" pid=907 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.911µs" storage_name=default system=housekeeping total_time=13.516243ms gitlab # [ 255.496505] gitaly[907]: time="2026-09-04T07:42:56.645Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:26.409" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.510" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.526069] gitaly[907]: time="2026-09-04T07:42:56.676Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:43:26.575" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:56.675" grpc.time_ms=0.574 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.544559] gitaly[907]: time="2026-09-04T07:42:56.694Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:26.593" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:56.694" grpc.time_ms=0.505 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.549883] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.699Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a9bfa3817d5dc5ebb7a8c30a","created_at":"2026-09-04T07:42:56.698Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"ecc5446f677f6764b0336f44","job_size_bytes":3,"pid":2622,"job_status":"deduplicated","message":"PipelineProcessWorker JID-a9bfa3817d5dc5ebb7a8c30a: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 255.550846] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.700Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ecc5446f677f6764b0336f44","created_at":"2026-09-04T07:42:56.454Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-db692ea49c474183","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.456Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2622,"job_status":"rescheduled","message":"PipelineProcessWorker JID-ecc5446f677f6764b0336f44: rescheduled"} gitlab # [ 255.555038] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.704Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ecc5446f677f6764b0336f44","created_at":"2026-09-04T07:42:56.454Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-db692ea49c474183","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.456Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ecc5446f677f6764b0336f44: done: 0.245134 sec","job_status":"done","queue_duration_s":0.002973,"scheduling_latency_s":0.003006,"gitaly_calls":3,"gitaly_duration_s":0.134082,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010057,"redis_read_bytes":239,"redis_write_bytes":21779,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00064,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000751,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.00215,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14464,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.004053,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00014,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000621,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082908,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.218067101,"duration_s":0.245134,"completed_at":"2026-09-04T07:42:56.704Z","load_balancing_strategy":"primary","db_duration_s":0.02204,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.596510] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.705Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3180d3fab8ea3cee2f5e2778","created_at":"2026-09-04T07:42:56.505Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.506Z","job_size_bytes":23,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3180d3fab8ea3cee2f5e2778: start","job_status":"start","queue_duration_s":0.199358,"scheduling_latency_s":0.199373} gitlab # [ 255.609734] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.731Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3180d3fab8ea3cee2f5e2778","created_at":"2026-09-04T07:42:56.505Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.506Z","job_size_bytes":23,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3180d3fab8ea3cee2f5e2778: done: 0.025333 sec","job_status":"done","queue_duration_s":0.199358,"scheduling_latency_s":0.199373,"redis_calls":7,"redis_duration_s":0.001309,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00033,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025333,"completed_at":"2026-09-04T07:42:56.731Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004998,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.659527] gitaly[907]: time="2026-09-04T07:42:56.712Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=68 command.spawn_token_fork_ms=64 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSJ499TJW3GHAYZGNEKD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:06.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.642" grpc.time_ms=70.068 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.660245] nixbot[2616]: {"ts": "2026-09-04T07:42:56.750Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b6d0f44d48756a4aa0c96dbc78c409b765d49176 \"HTTP/1.1 201 Created\""} gitlab # [ 255.660747] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b6d0f44d48756a4aa0c96dbc78c409b765d49176 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 169 gitlab # [ 255.663191] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.732Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"20d9a1d5d26c3dcbc619d18c","created_at":"2026-09-04T07:42:56.644Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.646Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-20d9a1d5d26c3dcbc619d18c: start","job_status":"start","queue_duration_s":0.086535,"scheduling_latency_s":0.086549} gitlab # [ 255.712462] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.753Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"20d9a1d5d26c3dcbc619d18c","created_at":"2026-09-04T07:42:56.644Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.646Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-20d9a1d5d26c3dcbc619d18c: done: 0.020558 sec","job_status":"done","queue_duration_s":0.086535,"scheduling_latency_s":0.086549,"redis_calls":7,"redis_duration_s":0.003505,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000748,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020558,"completed_at":"2026-09-04T07:42:56.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.713254] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.754Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a26c2c83a29961f084e3eb29","created_at":"2026-09-04T07:42:56.650Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.651Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a26c2c83a29961f084e3eb29: start","job_status":"start","queue_duration_s":0.102302,"scheduling_latency_s":0.102317} gitlab # [ 255.727744] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.778Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a26c2c83a29961f084e3eb29","created_at":"2026-09-04T07:42:56.650Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.651Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a26c2c83a29961f084e3eb29: done: 0.024454 sec","job_status":"done","queue_duration_s":0.102302,"scheduling_latency_s":0.102317,"redis_calls":7,"redis_duration_s":0.001422,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000518,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024454,"completed_at":"2026-09-04T07:42:56.778Z","load_balancing_strategy":"primary","db_duration_s":0.005516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.778735] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.780Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e2f4c90e49f90e303cd8f05d","created_at":"2026-09-04T07:42:56.657Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.658Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e2f4c90e49f90e303cd8f05d: start","job_status":"start","queue_duration_s":0.121984,"scheduling_latency_s":0.122004} gitlab # [ 255.779520] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.802Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e2f4c90e49f90e303cd8f05d","created_at":"2026-09-04T07:42:56.657Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.658Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e2f4c90e49f90e303cd8f05d: done: 0.022007 sec","job_status":"done","queue_duration_s":0.121984,"scheduling_latency_s":0.122004,"redis_calls":10,"redis_duration_s":0.001382,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000434,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022007,"completed_at":"2026-09-04T07:42:56.801Z","load_balancing_strategy":"primary","db_duration_s":0.003448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.828341] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 41 gitlab # [ 255.828883] gitlab-workhorse[827]: time="2026-09-04T07:42:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 255.829455] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 50 gitlab # [ 255.829951] gitaly[907]: time="2026-09-04T07:42:56.882Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXST84B6760BFX9X54D31 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:56.875" grpc.time_ms=6.308 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 255.833682] gitaly[907]: time="2026-09-04T07:42:56.933Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSVK8GEWXNV8BPHY067V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:56.926" pid=907 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 255.841155] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.803Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6142a8ca690bb3854fcb1897","created_at":"2026-09-04T07:42:56.658Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.659Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6142a8ca690bb3854fcb1897: start","job_status":"start","queue_duration_s":0.143986,"scheduling_latency_s":0.144005} gitlab # [ 255.853238] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6142a8ca690bb3854fcb1897","created_at":"2026-09-04T07:42:56.658Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.659Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6142a8ca690bb3854fcb1897: done: 0.023443 sec","job_status":"done","queue_duration_s":0.143986,"scheduling_latency_s":0.144005,"redis_calls":7,"redis_duration_s":0.00103,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023443,"completed_at":"2026-09-04T07:42:56.826Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008805,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.900992] gitaly[907]: time="2026-09-04T07:42:56.933Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSVK8GEWXNV8BPHY067V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:56.926" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 255.901666] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 51 gitlab # [ 255.902447] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.828Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0927d09bff4dfb8d4049dac0","created_at":"2026-09-04T07:42:56.659Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.661Z","job_size_bytes":19,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0927d09bff4dfb8d4049dac0: start","job_status":"start","queue_duration_s":0.166956,"scheduling_latency_s":0.166975} gitlab # [ 255.942964] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.843Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0927d09bff4dfb8d4049dac0","created_at":"2026-09-04T07:42:56.659Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.661Z","job_size_bytes":19,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0927d09bff4dfb8d4049dac0: done: 0.015875 sec","job_status":"done","queue_duration_s":0.166956,"scheduling_latency_s":0.166975,"redis_calls":8,"redis_duration_s":0.001575,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015875,"completed_at":"2026-09-04T07:42:56.843Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.982812] gitaly[907]: time="2026-09-04T07:42:56.933Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSVK8GEWXNV8BPHY067V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:56.926" grpc.time_ms=6.828 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 255.983570] gitlab-workhorse[827]: time="2026-09-04T07:42:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 255.984048] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 49 gitlab # [ 255.984517] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.844Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"fbb929381abd88f30874b64f","created_at":"2026-09-04T07:42:56.661Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.662Z","job_size_bytes":66,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-fbb929381abd88f30874b64f: start","job_status":"start","queue_duration_s":0.182413,"scheduling_latency_s":0.182427} gitlab # [ 255.985159] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.858Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"fbb929381abd88f30874b64f","created_at":"2026-09-04T07:42:56.661Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.662Z","job_size_bytes":66,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-fbb929381abd88f30874b64f: done: 0.013458 sec","job_status":"done","queue_duration_s":0.182413,"scheduling_latency_s":0.182427,"redis_calls":7,"redis_duration_s":0.000925,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013458,"completed_at":"2026-09-04T07:42:56.858Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.032889] gitaly[907]: time="2026-09-04T07:42:57.008Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSXXYV1TPWA5K1BKD9EE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:56.999" grpc.time_ms=8.508 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 256.033536] gitaly[907]: time="2026-09-04T07:42:57.036Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:57.036" grpc.time_ms=0.334 pid=907 span.kind=server system=grpc gitlab # [ 256.036944] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.859Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"035e6cc5da6b180410be96dd","created_at":"2026-09-04T07:42:56.663Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.663Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-035e6cc5da6b180410be96dd: start","job_status":"start","queue_duration_s":0.195504,"scheduling_latency_s":0.195517} gitlab # [ 256.074707] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.890Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"035e6cc5da6b180410be96dd","created_at":"2026-09-04T07:42:56.663Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.663Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-035e6cc5da6b180410be96dd: done: 0.031359 sec","job_status":"done","queue_duration_s":0.195504,"scheduling_latency_s":0.195517,"redis_calls":7,"redis_duration_s":0.006144,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002528,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003616,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031359,"completed_at":"2026-09-04T07:42:56.890Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.120739] gitaly[907]: time="2026-09-04T07:42:57.060Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSZJF2EDE6CCYWFA7DCT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.054" pid=907 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 256.121535] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.892Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"e96823054fb5ee0d97695c15","created_at":"2026-09-04T07:42:56.666Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.666Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e96823054fb5ee0d97695c15: start","job_status":"start","queue_duration_s":0.225171,"scheduling_latency_s":0.225187} gitlab # [ 256.122200] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.909Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"e96823054fb5ee0d97695c15","created_at":"2026-09-04T07:42:56.666Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.666Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e96823054fb5ee0d97695c15: done: 0.01761 sec","job_status":"done","queue_duration_s":0.225171,"scheduling_latency_s":0.225187,"redis_calls":7,"redis_duration_s":0.001758,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000709,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01761,"completed_at":"2026-09-04T07:42:56.909Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.165212] gitaly[907]: time="2026-09-04T07:42:57.060Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSZJF2EDE6CCYWFA7DCT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.054" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 256.165882] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.910Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"603081d7fc3c233b870a7630","created_at":"2026-09-04T07:42:56.667Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.668Z","job_size_bytes":6,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-603081d7fc3c233b870a7630: start","job_status":"start","queue_duration_s":0.242654,"scheduling_latency_s":0.242668} gitlab # [ 256.202631] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.919Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"603081d7fc3c233b870a7630","created_at":"2026-09-04T07:42:56.667Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.668Z","job_size_bytes":6,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-603081d7fc3c233b870a7630: done: 0.008803 sec","job_status":"done","queue_duration_s":0.242654,"scheduling_latency_s":0.242668,"redis_calls":7,"redis_duration_s":0.000933,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008803,"completed_at":"2026-09-04T07:42:56.919Z","load_balancing_strategy":"primary","db_duration_s":0.000237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.203861] gitaly[907]: time="2026-09-04T07:42:57.060Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSZJF2EDE6CCYWFA7DCT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.054" grpc.time_ms=6.25 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 256.216184] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.920Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"ffedf88177965001472ac5c9","created_at":"2026-09-04T07:42:56.668Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.669Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ffedf88177965001472ac5c9: start","job_status":"start","queue_duration_s":0.251327,"scheduling_latency_s":0.25134} gitlab # [ 256.265088] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.943Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"ffedf88177965001472ac5c9","created_at":"2026-09-04T07:42:56.668Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.669Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ffedf88177965001472ac5c9: done: 0.022949 sec","job_status":"done","queue_duration_s":0.251327,"scheduling_latency_s":0.25134,"redis_calls":7,"redis_duration_s":0.0012200000000000002,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000389,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022949,"completed_at":"2026-09-04T07:42:56.943Z","load_balancing_strategy":"primary","db_duration_s":0.00441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.266285] sidekiq-cluster[2622]: {"severity":"INFO","time":"2026-09-04T07:42:56.944Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"4858b15372adf0bd064a9a0d","created_at":"2026-09-04T07:42:56.701Z","trace_propagation_headers":{"sentry-trace":"b148cdd1f06149f2875b075785c12e67-7e525ddad1864653","baggage":"sentry-trace_id=b148cdd1f06149f2875b075785c12e67,sentry-release=Unknown"},"correlation_id":"01M1NNXSAYXQ0M2CHF2ZNE0PQ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:56.701Z","job_size_bytes":3,"pid":2622,"sidekiq_tid":"m82y","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4858b15372adf0bd064a9a0d: start","job_status":"start","queue_duration_s":0.242699,"scheduling_latency_s":0.242716} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses gitlab # [ 256.334445] gitaly[907]: time="2026-09-04T07:42:57.484Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:57.483" grpc.time_ms=0.347 pid=907 span.kind=server system=grpc gitlab # [ 256.365601] gitaly[907]: time="2026-09-04T07:42:57.515Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:57.515" grpc.time_ms=0.496 pid=907 span.kind=server system=grpc gitlab # [ 256.384253] gitaly[907]: time="2026-09-04T07:42:57.534Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 diskcache=827d80a7-8856-4015-815e-d8848be46024 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:26.889" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.989" pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.385276] gitaly[907]: time="2026-09-04T07:42:57.535Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=77 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=823296 command.minflt=7433 command.oublock=0 command.real_time_ms=536 command.spawn_token_fork_ms=2 command.system_time_ms=48 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:43:26.889" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:56.989" grpc.time_ms=544.861 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.409435] gitaly[907]: time="2026-09-04T07:42:57.559Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXTFHQF8JGZY842TAT5FR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:27.257" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:57.558" grpc.time_ms=0.677 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.428365] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 56 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b6d0f44d48756a4aa0c96dbc78c409b765d49176/statuses, in 0.10 seconds) (finished: subtest: eval and build post commit statuses, in 5.87 seconds) (finished: run the VM test script, in 330.47 seconds) gitlab # [ 256.444525] gitaly[907]: time="2026-09-04T07:42:57.594Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSAYXQ0M2CHF2ZNE0PQ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:43:27.493" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:57.593" grpc.time_ms=0.652 pid=907 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root test script finished in 330.50s cleanup kill QemuMachine (pid 46) gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.29 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-04T07:41:57.980Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'b6d0f44d48756a4aa0c96dbc78c409b765d49176', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-04T07:42:50.230337Z', 'started_at': '2026-09-04T07:42:50.473520Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}] [{'id': 5, 'sha': 'b6d0f44d48756a4aa0c96dbc78c409b765d49176', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:42:50.447Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'b6d0f44d48756a4aa0c96dbc78c409b765d49176', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:42:50.447Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'b6d0f44d48756a4aa0c96dbc78c409b765d49176', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:42:50.447Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'b6d0f44d48756a4aa0c96dbc78c409b765d49176', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:42:50.447Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'b6d0f44d48756a4aa0c96dbc78c409b765d49176', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:42:50.447Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'b6d0f44d48756a4aa0c96dbc78c409b765d49176', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-09-04T07:42:50.447Z', 'started_at': None, 'finished_at': '2026-09-04T07:42:56.447Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'b6d0f44d48756a4aa0c96dbc78c409b765d49176', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-04T07:42:56.550Z', 'started_at': None, 'finished_at': '2026-09-04T07:42:56.729Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]