tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab: QEMU running (pid 46) gitlab # Formatting '/build/vm-state-gitlab/tmp.8nrca160kv', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab # Discarding device blocks: 0/262144 done gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: 73067f42-93dd-476c-b89c-66c1b4619e9b gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done (finished: start all VMs, in 47.27 seconds) gitlab # gitlab: waiting for unit setup-gitlab.service gitlab # Virtualisation disk image created. gitlab: waiting for the VM to finish booting gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pq9ax0qa3qdjg2snnx0gk3031c2q4k4f-nixos-system-gitlab-test/init regInfo=/nix/store/z18ifqi63705rxzvqzfb0m0hw25a1gqh-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 496087482 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000877] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002749] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002760] Using GB pages for direct mapping gitlab # [ 0.002935] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002941] ACPI: Early table checksum verification disabled gitlab # [ 0.002944] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002948] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002952] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002958] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002960] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002962] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002964] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002966] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002968] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002968] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002969] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002969] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002970] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002970] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003190] No NUMA configuration found gitlab # [ 0.003191] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003193] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff] gitlab # [ 0.006245] Zone ranges: gitlab # [ 0.006246] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.006248] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.006249] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.006250] Device empty gitlab # [ 0.006251] Movable zone start for each node gitlab # [ 0.006252] Early memory node ranges gitlab # [ 0.006252] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.006253] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.006254] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.006255] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.006275] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.006560] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.122865] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.123294] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.123311] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.123348] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.123351] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.123352] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.123354] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.123355] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.123356] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.123358] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.123359] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.123364] TSC deadline timer available gitlab # [ 0.123369] CPU topo: Max. logical packages: 1 gitlab # [ 0.123369] CPU topo: Max. logical dies: 1 gitlab # [ 0.123370] CPU topo: Max. dies per package: 1 gitlab # [ 0.123373] CPU topo: Max. threads per core: 1 gitlab # [ 0.123374] CPU topo: Num. cores per package: 4 gitlab # [ 0.123374] CPU topo: Num. threads per package: 4 gitlab # [ 0.123375] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.123400] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.123418] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.123421] kvm-guest: setup PV sched yield gitlab # [ 0.123437] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.123438] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.123439] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.123441] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.123443] Booting paravirtualized kernel on KVM gitlab # [ 0.123447] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.127909] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.130263] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.130317] kvm-guest: PV spinlocks enabled gitlab # [ 0.130319] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.130322] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pq9ax0qa3qdjg2snnx0gk3031c2q4k4f-nixos-system-gitlab-test/init regInfo=/nix/store/z18ifqi63705rxzvqzfb0m0hw25a1gqh-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.130421] Unknown kernel command line parameters "regInfo=/nix/store/z18ifqi63705rxzvqzfb0m0hw25a1gqh-closure-info/registration", will be passed to user space. gitlab # [ 0.130435] random: crng init done gitlab # [ 0.130435] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.140060] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.145060] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.145140] software IO TLB: area num 4. gitlab # [ 0.226278] Fallback order for Node 0: 0 gitlab # [ 0.226287] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.226289] Policy zone: Normal gitlab # [ 0.228975] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.239479] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.254528] allocated 12582912 bytes of page_ext gitlab # [ 0.264776] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.264778] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.265717] Dynamic Preempt: lazy gitlab # [ 0.265920] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.265921] rcu: RCU event tracing is enabled. gitlab # [ 0.265922] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.265924] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.265924] Rude variant of Tasks RCU enabled. gitlab # [ 0.265924] Tracing variant of Tasks RCU enabled. gitlab # [ 0.265925] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.265926] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.265942] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.265944] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.265945] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.270377] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.270678] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.270687] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.270813] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.274397] Console: colour VGA+ 80x25 gitlab # [ 0.274400] printk: legacy console [tty0] enabled gitlab # [ 0.305068] printk: legacy console [ttyS0] enabled gitlab # [ 0.409895] ACPI: Core revision 20250807 gitlab # [ 0.410912] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.412547] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.413583] x2apic enabled gitlab # [ 0.414351] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.415314] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.416613] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.418136] kvm-guest: setup PV IPIs gitlab # [ 0.419776] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.420904] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.422732] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008) gitlab # [ 0.423825] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.425792] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.427728] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.428734] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.430729] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.432730] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.433729] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.434729] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.435729] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.437740] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.438730] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.439730] active return thunk: srso_alias_return_thunk gitlab # [ 0.440759] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.442728] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.443729] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.444729] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.445729] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.446728] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.448630] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.449729] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.450729] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.451729] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.452729] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.453729] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.455578] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.486786] Freeing SMP alternatives memory: 44K gitlab # [ 0.487674] pid_max: default: 32768 minimum: 301 gitlab # [ 0.488462] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.489818] landlock: Up and running. gitlab # [ 0.490491] Yama: becoming mindful. gitlab # [ 0.490948] LSM support for eBPF active gitlab # [ 0.491973] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.493902] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.496645] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.497317] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.497735] ... version: 2 gitlab # [ 0.498550] ... bit width: 48 gitlab # [ 0.499331] ... generic counters: 6 gitlab # [ 0.499795] ... generic bitmap: 000000000000003f gitlab # [ 0.500732] ... fixed-purpose counters: 0 gitlab # [ 0.501510] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.501732] ... value mask: 0000ffffffffffff gitlab # [ 0.502734] ... max period: 00007fffffffffff gitlab # [ 0.503732] ... global_ctrl mask: 000000000000003f gitlab # [ 0.504864] signal: max sigframe size: 3376 gitlab # [ 0.505769] rcu: Hierarchical SRCU implementation. gitlab # [ 0.506643] rcu: Max phase no-delay instances is 400. gitlab # [ 0.507735] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.513404] smp: Bringing up secondary CPUs ... gitlab # [ 0.514195] smpboot: x86: Booting SMP configuration: gitlab # [ 0.514743] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.518759] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.520310] smpboot: Total of 4 processors activated (19200.06 BogoMIPS) gitlab # [ 0.521260] Memory: 6011580K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved) gitlab # [ 0.523074] devtmpfs: initialized gitlab # [ 0.524031] x86/mm: Memory block size: 128MB gitlab # [ 0.527790] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.528834] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.529860] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.531041] PM: RTC time: 16:42:14, date: 2026-08-16 gitlab # [ 0.535505] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.538112] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.538810] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.540954] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.541748] audit: initializing netlink subsys (disabled) gitlab # [ 0.542765] audit: type=2000 audit(1786898534.256:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.543021] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.544733] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.545733] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.546733] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.547734] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.548798] cpuidle: using governor menu gitlab # [ 0.550989] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.552093] PCI: Using configuration type 1 for base access gitlab # [ 0.552734] PCI: Using configuration type 1 for extended access gitlab # [ 0.553963] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.556805] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.557734] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.558733] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.559733] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.565475] ACPI: Added _OSI(Module Device) gitlab # [ 0.566740] ACPI: Added _OSI(Processor Device) gitlab # [ 0.568740] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.575793] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.582045] ACPI: Interpreter enabled gitlab # [ 0.582754] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.583481] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.585128] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.588738] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.592390] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.605628] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.608806] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.613089] acpiphp: Slot [3] registered gitlab # [ 0.614822] acpiphp: Slot [4] registered gitlab # [ 0.616788] acpiphp: Slot [5] registered gitlab # [ 0.617804] acpiphp: Slot [6] registered gitlab # [ 0.618788] acpiphp: Slot [7] registered gitlab # [ 0.620783] acpiphp: Slot [8] registered gitlab # [ 0.621783] acpiphp: Slot [9] registered gitlab # [ 0.622802] acpiphp: Slot [10] registered gitlab # [ 0.624786] acpiphp: Slot [11] registered gitlab # [ 0.625786] acpiphp: Slot [12] registered gitlab # [ 0.626801] acpiphp: Slot [13] registered gitlab # [ 0.628783] acpiphp: Slot [14] registered gitlab # [ 0.629772] acpiphp: Slot [15] registered gitlab # [ 0.630774] acpiphp: Slot [16] registered gitlab # [ 0.632793] acpiphp: Slot [17] registered gitlab # [ 0.633774] acpiphp: Slot [18] registered gitlab # [ 0.634489] acpiphp: Slot [19] registered gitlab # [ 0.634752] acpiphp: Slot [20] registered gitlab # [ 0.635522] acpiphp: Slot [21] registered gitlab # [ 0.636754] acpiphp: Slot [22] registered gitlab # [ 0.637453] acpiphp: Slot [23] registered gitlab # [ 0.637751] acpiphp: Slot [24] registered gitlab # [ 0.638510] acpiphp: Slot [25] registered gitlab # [ 0.639752] acpiphp: Slot [26] registered gitlab # [ 0.640471] acpiphp: Slot [27] registered gitlab # [ 0.640763] acpiphp: Slot [28] registered gitlab # [ 0.641494] acpiphp: Slot [29] registered gitlab # [ 0.642779] acpiphp: Slot [30] registered gitlab # [ 0.643502] acpiphp: Slot [31] registered gitlab # [ 0.643746] PCI host bridge to bus 0000:00 gitlab # [ 0.644479] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.645739] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.646731] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.647732] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.649731] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.650752] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.653615] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.658196] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.662807] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.670828] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.672805] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.675738] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.677736] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.680739] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.683270] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.689920] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.694364] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.698414] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.700747] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.703180] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.726851] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.728747] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.729701] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.729727] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.734621] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.746761] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.749757] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.751795] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.782752] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.788060] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.795762] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.797750] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.799806] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.804209] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.814769] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.816769] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.819793] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.826889] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.837788] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.839753] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.842791] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.848949] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.859773] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.860671] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.861541] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.864703] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.869790] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.870726] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.872475] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.875661] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.882799] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.885763] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.888812] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.891761] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.898246] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.905770] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.908807] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.915115] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.924783] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.926753] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.928796] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.934340] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.941951] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.942741] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.943761] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.948402] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.949890] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.950880] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.951910] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.953813] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.956808] iommu: Default domain type: Translated gitlab # [ 0.957348] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.959004] ACPI: bus type USB registered gitlab # [ 0.959833] usbcore: registered new interface driver usbfs gitlab # [ 0.960725] usbcore: registered new interface driver hub gitlab # [ 0.961606] usbcore: registered new device driver usb gitlab # [ 0.963674] NetLabel: Initializing gitlab # [ 0.964149] NetLabel: domain hash size = 128 gitlab # [ 0.964731] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.965719] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.966405] PCI: Using ACPI for IRQ routing gitlab # [ 0.968100] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.968713] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.968727] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.971735] vgaarb: loaded gitlab # [ 0.972486] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.972730] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.977832] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.979537] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.980213] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.981747] pnp: PnP ACPI init gitlab # [ 0.982933] pnp: PnP ACPI: found 6 devices gitlab # [ 0.994402] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.997961] clocksource: Switched to clocksource acpi_pm gitlab # [ 1.000736] NET: Registered PF_INET protocol family gitlab # [ 1.005958] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 1.044587] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 1.046121] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 1.047545] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 1.050286] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 1.051623] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 1.053293] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 1.054929] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 1.056401] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 1.057845] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 1.058938] NET: Registered PF_XDP protocol family gitlab # [ 1.059843] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 1.060890] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 1.061943] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 1.063133] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 1.064272] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 1.065698] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 1.066677] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 1.069214] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 1.072005] PCI: CLS 0 bytes, default 64 gitlab # [ 1.072849] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 1.073724] Trying to unpack rootfs image as initramfs... gitlab # [ 1.073934] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 1.074115] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 1.098345] Initialise system trusted keyrings gitlab # [ 1.099666] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 1.111611] Key type asymmetric registered gitlab # [ 1.112355] Asymmetric key parser 'x509' registered gitlab # [ 1.113344] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 1.115286] io scheduler mq-deadline registered gitlab # [ 1.116074] io scheduler kyber registered gitlab # [ 1.121489] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 1.122861] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 1.125581] Linux agpgart interface v0.103 gitlab # [ 1.126444] ACPI: bus type drm_connector registered gitlab # [ 1.129551] usbcore: registered new interface driver usbserial_generic gitlab # [ 1.130657] usbserial: USB Serial support registered for generic gitlab # [ 1.131691] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 1.131691] Please enable it if your BIOS has the CPPC option. gitlab # [ 1.134065] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 1.135499] drop_monitor: Initializing network drop monitor service gitlab # [ 1.136750] NET: Registered PF_INET6 protocol family gitlab # [ 1.138665] Segment Routing with IPv6 gitlab # [ 1.139386] In-situ OAM (IOAM) with IPv6 gitlab # [ 1.142387] IPI shorthand broadcast: enabled gitlab # [ 1.146884] sched_clock: Marking stable (1002014629, 144040714)->(1177349265, -31293922) gitlab # [ 1.148872] registered taskstats version 1 gitlab # [ 1.149909] Loading compiled-in X.509 certificates gitlab # [ 1.160232] Demotion targets for Node 0: null gitlab # [ 1.161646] Key type .fscrypt registered gitlab # [ 1.162376] Key type fscrypt-provisioning registered gitlab # [ 1.163366] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.164321] ima: Allocated hash algorithm: sha1 gitlab # [ 1.165129] ima: No architecture policies found gitlab # [ 1.166322] PM: Magic number: 6:596:742 gitlab # [ 1.168206] RAS: Correctable Errors collector initialized. gitlab # [ 1.172707] clk: Disabling unused clocks gitlab # [ 1.173451] PM: genpd: Disabling unused power domains gitlab # [ 1.372210] Freeing initrd memory: 29392K gitlab # [ 1.379645] Freeing unused decrypted memory: 2028K gitlab # [ 1.386141] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.388719] Write protecting the kernel read-only data: 32768k gitlab # [ 1.393646] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.397491] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.465972] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.467084] Run /init as init process gitlab # [ 1.481515] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.505561] fuse: init (API version 7.45) gitlab # [ 1.513720] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.521621] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.525175] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.568101] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.907287] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.947284] systemd[1]: Detected virtualization kvm. gitlab # [ 1.949390] systemd[1]: Detected architecture x86-64. gitlab # [ 1.951485] systemd[1]: Running in initrd. gitlab # [ 1.954130] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.956878] systemd[1]: Hostname set to . gitlab # [ 2.065433] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 2.124549] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 2.134821] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 2.135991] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 2.137444] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 2.139102] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 2.141139] systemd[1]: Reached target Path Units. gitlab # [ 2.142752] systemd[1]: Reached target Slice Units. gitlab # [ 2.144445] systemd[1]: Reached target Swaps. gitlab # [ 2.145937] systemd[1]: Reached target Timer Units. gitlab # [ 2.147780] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 2.149636] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 2.150801] systemd[1]: Listening on Journal Sockets. gitlab # [ 2.151833] systemd[1]: Listening on udev Control Socket. gitlab # [ 2.152875] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 2.153851] systemd[1]: Reached target Socket Units. gitlab # [ 2.155959] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 2.158011] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 2.160082] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 2.168263] systemd[1]: Starting Journal Service... gitlab # [ 2.174173] systemd[1]: Starting Load Kernel Modules... gitlab # [ 2.175126] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 2.179751] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.190802] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.196882] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.201900] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.205414] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.215653] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 2.216221] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.219915] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 2.220528] systemd-journald[91]: Collecting audit messages is disabled. gitlab # [ 2.222811] netfs: FS-Cache loaded gitlab # [ 2.233344] 9pnet: Installing 9P2000 support gitlab # [ 2.233680] systemd[1]: Finished Load Kernel Modules. gitlab # [ 2.236758] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 2.238672] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.240575] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 2.245381] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 2.251119] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 2.252801] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 2.261524] systemd[1]: Started Journal Service. gitlab # [ 2.117601] systemd-modules-load[92]: Using 4 probe threads gitlab # [ 2.119451] systemd-modules-load[92]: Inserted module 'virtio_balloon' gitlab # [ 2.120441] systemd-modules-load[92]: Inserted module 'dm_mod' gitlab # [ 2.121317] systemd-modules-load[92]: Inserted module 'virtio_gpu' gitlab # [ 2.122232] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 2.125357] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 2.126366] systemd[1]: Reached target Local File Systems. gitlab # [ 2.127206] systemd[1]: Starting Create System Files and Directories... gitlab # [ 2.128134] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 2.135190] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.144777] systemd-udevd[106]: Using default interface naming scheme 'v261'. gitlab # [ 2.155156] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.187621] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.188803] systemd[1]: Reached target System Initialization. gitlab # [ 2.190218] systemd[1]: Reached target Basic System. gitlab # [ 2.412558] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.415704] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.416765] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.417591] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.418658] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.419815] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.420840] usb usb1: Product: UHCI Host Controller gitlab # [ 2.421531] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.422303] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.428660] SCSI subsystem initialized gitlab # [ 2.438716] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.444880] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.446814] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.446831] hub 1-0:1.0: USB hub found gitlab # [ 2.447084] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.451615] hub 1-0:1.0: 2 ports detected gitlab # [ 2.452287] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.459695] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.477130] scsi host0: ata_piix gitlab # [ 2.479662] scsi host1: ata_piix gitlab # [ 2.479754] virtio_blk virtio5: [vdb] 11830752 512-byte logical blocks (6.06 GB/5.64 GiB) gitlab # [ 2.479934] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.483291] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.349381] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.369361] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.370957] systemd-vconsole-setup[151]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.372474] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.373393] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.374226] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.375111] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.399451] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.402663] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.647329] ata2: found unknown device (class 0) gitlab # [ 2.649143] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.653569] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.673078] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.531698] (udev-worker)[124]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.536057] (udev-worker)[124]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.540618] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.687355] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.723315] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.750771] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.840113] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.841307] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.842331] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.842911] usb 1-1: Manufacturer: QEMU gitlab # [ 2.843497] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.874887] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.888331] usbcore: registered new interface driver usbhid gitlab # [ 2.890293] usbhid: USB HID core driver gitlab # [ 2.899926] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.903495] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 3.045903] systemd[1]: Mounting /sysroot... gitlab # [ 3.329160] EXT4-fs (vda): mounted filesystem 73067f42-93dd-476c-b89c-66c1b4619e9b r/w with ordered data mode. Quota mode: none. gitlab # [ 3.191903] systemd[1]: Mounted /sysroot. gitlab # [ 3.193359] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.196933] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.198816] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.210484] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.214981] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.217210] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.220702] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.223534] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.230524] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.232485] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.235717] systemd-sysroot-fstab-check[180]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.384763] 9p: Installing v9fs 9p2000 file system support gitlab # [ 3.241065] systemd[1]: Reload requested from client PID 180 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.243035] systemd[1]: Reloading... gitlab # [ 3.386942] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.302834] systemd[1]: Reloading finished in 62 ms. gitlab # [ 3.326624] systemd-sysroot-fstab-check[180]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.329407] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.331234] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.332933] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.334681] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.337280] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.339244] systemd-sysroot-fstab-check[180]: Requesting swap.target/start/replace... gitlab # [ 3.341643] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.343710] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.345966] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.348342] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.356876] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.359261] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.046757] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 4.097838] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 4.099715] systemd[1]: Reached target Initrd File Systems. gitlab # [ 4.102154] systemd[1]: Starting Find NixOS closure... gitlab # [ 4.104205] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 4.142224] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 4.144898] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 4.160105] systemd[1]: Finished Find NixOS closure. gitlab # [ 4.161740] systemd[1]: Reached target Initrd Default Target. gitlab # [ 4.163532] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.191414] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.193669] systemd[1]: Stopped target Basic System. gitlab # [ 4.195325] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.197101] systemd[1]: Stopped target Path Units. gitlab # [ 4.198615] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.200866] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.203263] systemd[1]: Stopped target Slice Units. gitlab # [ 4.204874] systemd[1]: Stopped target Socket Units. gitlab # [ 4.206440] systemd[1]: Stopped target System Initialization. gitlab # [ 4.208620] systemd[1]: Stopped target Swaps. gitlab # [ 4.210274] systemd[1]: Stopped target Timer Units. gitlab # [ 4.213391] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.215460] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.217570] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.221371] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.223562] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.227302] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.229314] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.231114] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.232743] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.234518] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.235808] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.237730] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.239690] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.241495] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.243112] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.244426] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.245829] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.247318] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.248450] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.250020] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.251351] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.252112] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.253192] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.254075] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.254992] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.255787] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.256657] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.257590] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.258501] systemd[1]: Closed udev Control Socket. gitlab # [ 4.259158] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.259882] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.260946] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.261744] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.262787] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.263743] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.264648] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.269768] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.270752] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.271914] systemd[1]: Reached target Switch Root. gitlab # [ 4.273816] systemd[1]: Starting NixOS Activation... gitlab # [ 4.405909] initrd-nixos-activation-start[231]: booting system configuration /nix/store/pq9ax0qa3qdjg2snnx0gk3031c2q4k4f-nixos-system-gitlab-test gitlab # [ 4.449844] initrd-nixos-activation-start[231]: running activation script... gitlab # [ 4.698688] initrd-nixos-activation-start[254]: setting up /etc... gitlab # [ 4.812068] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.813645] systemd[1]: Finished NixOS Activation. gitlab # [ 4.815814] systemd[1]: Starting Switch Root... gitlab # [ 4.848362] systemd[1]: Switching root. gitlab # [ 5.054940] systemd-journald[91]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.185376] NET: Registered PF_VSOCK protocol family gitlab # [ 5.558590] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.568427] systemd[1]: Detected virtualization kvm. gitlab # [ 5.570208] systemd[1]: Detected architecture x86-64. gitlab # [ 5.572116] systemd[1]: Detected first boot. gitlab # [ 5.574591] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.725290] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.827853] systemd[1]: Applying preset policy. gitlab # [ 6.013769] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.128682] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.131897] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.136871] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.142239] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.145717] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.149329] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.151628] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.154584] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.157337] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.159138] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 6.161003] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.163156] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.165152] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.167158] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.169275] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.171627] systemd[1]: Reached target Path Units. gitlab # [ 6.173464] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.175430] systemd[1]: Reached target Slice Units. gitlab # [ 6.177236] systemd[1]: Reached target Swaps. gitlab # [ 6.180391] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.184363] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.187137] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.190328] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.192170] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.196797] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.198419] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.200021] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.201122] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.202197] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.203486] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.206147] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.207209] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.208066] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.211226] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.213343] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.215428] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.219121] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.226622] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.229961] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 6.238517] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 6.242391] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.243919] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.245460] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.268358] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.269250] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.273420] systemd[1]: Starting Journal Service... gitlab # [ 6.277122] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.283267] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.290104] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.292792] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.300795] systemd-journald[325]: Collecting audit messages is enabled. gitlab # [ 6.302258] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.311017] loop: module loaded gitlab # [ 6.311233] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.314236] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.317196] EXT4-fs (vda): re-mounted 73067f42-93dd-476c-b89c-66c1b4619e9b. gitlab # [ 6.318163] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.318323] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.321765] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.323294] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.324453] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 6.181284] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.325808] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 6.327334] systemd[1]: Started Journal Service. gitlab # [ 6.183966] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 6.185097] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 6.186267] systemd-modules-load[326]: Using 3 probe threads gitlab # [ 6.187357] systemd-modules-load[326]: Inserted module 'loop' gitlab # [ 6.188316] systemd-modules-load[326]: Inserted module 'tls' gitlab # [ 6.189617] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.190965] systemd[1]: Finished Load Kernel Modules. gitlab # [ 6.191809] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.192822] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.196215] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.200066] systemd[1]: Starting Firewall... gitlab # [ 6.200737] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.201585] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.207342] systemd-oomd[327]: No swap; memory pressure usage will be degraded gitlab # [ 6.208762] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.212790] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.362787] systemd-journald[325]: Received client request to flush runtime journal. gitlab # [ 6.263756] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.265238] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.266692] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.267979] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.268988] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.270064] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.270852] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.271629] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.272602] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.273454] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.274267] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.275125] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.276040] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.305079] systemd-udevd[360]: Using default interface naming scheme 'v261'. gitlab # [ 6.320089] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 6.335891] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.403283] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.423234] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.458212] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.460559] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.465546] (udev-worker)[419]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.468047] (udev-worker)[419]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.482648] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.483827] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.485239] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.487977] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.489873] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.491092] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.659020] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.531053] systemd[1]: Finished Firewall. gitlab # [ 6.675844] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.681251] ACPI: button: Power Button [PWRF] gitlab # [ 6.688279] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.693885] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.699794] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.702560] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 6.705276] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.714400] FDC 0 is a S82078B gitlab # [ 6.716155] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.717778] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.730266] Console: switching to colour dummy device 80x25 gitlab # [ 6.731178] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.731723] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.734388] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.734915] rtc_cmos 00:05: setting system clock to 2026-08-16T16:42:20 UTC (1786898540) gitlab # [ 6.736420] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.736531] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 gitlab # [ 6.737257] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.737401] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4 gitlab # [ 6.739160] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.749013] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.752603] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.758436] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.678248] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.696278] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.699987] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.717049] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.867938] ppdev: user-space parallel port driver gitlab # [ 6.904960] kvm_amd: TSC scaling supported gitlab # [ 6.905595] kvm_amd: Nested Virtualization enabled gitlab # [ 6.906266] kvm_amd: Nested Paging enabled gitlab # [ 6.906761] kvm_amd: LBR virtualization supported gitlab # [ 6.907393] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.907954] kvm_amd: Virtual GIF supported gitlab # [ 6.908473] kvm_amd: Virtual NMI enabled gitlab # [ 6.944171] EDAC MC: Ver: 3.0.0 gitlab # [ 6.800203] systemd-vconsole-setup[498]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.803886] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.988858] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.011565] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.013580] systemd[1]: Reached target Local File Systems. gitlab # [ 7.015561] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.017850] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.020450] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.022437] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.025352] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.031233] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.066818] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.071142] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.080329] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.086128] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.089487] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.120574] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.136647] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.138344] systemd[1]: Starting Update is Completed... gitlab # [ 7.155981] systemd[1]: Finished Update is Completed. gitlab # [ 7.181386] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.182399] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.428760] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.430342] systemd[1]: Reached target System Initialization. gitlab # [ 7.431581] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.432973] systemd[1]: Started logrotate.timer. gitlab # [ 7.434163] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.435482] systemd[1]: Reached target Timer Units. gitlab # [ 7.436653] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.437942] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.444884] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.446194] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.447752] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.448951] systemd[1]: Reached target Socket Units. gitlab # [ 7.451460] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.504598] dbus-broker-launch[580]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.507781] dbus-broker-launch[580]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.510392] dbus-broker-launch[580]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.515685] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.527384] dbus-broker-launch[580]: Ready gitlab # [ 7.530311] systemd[1]: Reached target Basic System. gitlab # [ 7.533512] systemd[1]: Started backdoor.service. gitlab # [ 7.536373] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.539593] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.551958] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.561510] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.567778] systemd[1]: Starting Post-Boot Actions... gitlab # connecting to host... gitlab # [ 7.575105] systemd[1]: Started Reset console on configuration changes. gitlab # [ 7.580112] systemd[1]: Starting resolvconf update... gitlab # [ 7.589231] logrotate[585]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 7.598512] logrotate[585]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # [ 7.600045] logrotate[585]: note: 'monthly' overrides previously specified 'weekly' gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.602416] logrotate[585]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.603450] logrotate[585]: state file /var/lib/logrotate.status does not exist gitlab: connected to guest root shell gitlab # [ 7.604453] logrotate[585]: Allocating hash table for state file, size 64 entries gitlab: (connecting took 8.25 seconds) gitlab # [ 7.605456] logrotate[585]: Handling 4 logs gitlab: (finished: waiting for the VM to finish booting, in 8.25 seconds) gitlab # [ 7.605973] logrotate[585]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.607731] logrotate[585]: considering log /var/log/btmp gitlab # [ 7.608495] logrotate[585]: Creating new state gitlab # [ 7.609045] logrotate[585]: Now: 2026-08-16 16:42 gitlab # [ 7.609665] logrotate[585]: Last rotated at 2026-08-16 16:00 gitlab # [ 7.610669] logrotate[585]: log does not need rotating (log has already been rotated) gitlab # [ 7.611102] logrotate[585]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.611529] logrotate[585]: considering log /var/log/wtmp gitlab # [ 7.611920] logrotate[585]: Creating new state gitlab # [ 7.612460] logrotate[585]: Now: 2026-08-16 16:42 gitlab # [ 7.612885] logrotate[585]: Last rotated at 2026-08-16 16:00 gitlab # [ 7.613539] logrotate[585]: log does not need rotating (log has already been rotated) gitlab # [ 7.614072] logrotate[585]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.614500] logrotate[585]: switching euid from 0 to 165 and egid from 0 to 165 (pid 585) gitlab # [ 7.614929] logrotate[585]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.615650] logrotate[585]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.616223] logrotate[585]: Creating new state gitlab # [ 7.616796] logrotate[585]: switching euid from 165 to 0 and egid from 165 to 0 (pid 585) gitlab # [ 7.617387] logrotate[585]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.617809] logrotate[585]: switching euid from 0 to 60 and egid from 0 to 60 (pid 585) gitlab # [ 7.618396] logrotate[585]: considering log /var/log/nginx/*.log gitlab # [ 7.618820] logrotate[585]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.619404] logrotate[585]: Creating new state gitlab # [ 7.619820] logrotate[585]: not running postrotate script, since no logs were rotated gitlab # [ 7.620149] logrotate[585]: switching euid from 60 to 0 and egid from 60 to 0 (pid 585) gitlab # [ 7.620658] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.621555] nsncd[586]: Aug 16 16:42:21.527 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.622932] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.623718] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.624589] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.625235] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.625654] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.626079] systemd[1]: Starting User Login Management... gitlab # [ 7.658441] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.658990] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.659793] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.660240] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.660701] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.662605] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.665086] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.665802] systemd[1]: nscd.service: Consumed 24ms CPU time over 104ms wall clock time, 7.5M memory peak, 5.5M read from disk. gitlab # [ 7.669542] systemd-logind[624]: New seat seat0. gitlab # [ 7.672321] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.675943] systemd-logind[624]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.676716] systemd-logind[624]: Watching system buttons on /dev/input/event4 (QEMU Virtio Keyboard) gitlab # [ 7.677218] systemd-logind[624]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.682771] systemd[1]: Started User Login Management. gitlab # [ 7.684100] systemd[1]: Starting linger-users.service... gitlab # [ 7.696459] nsncd[678]: Aug 16 16:42:21.605 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.697256] systemd[1]: Finished resolvconf update. gitlab # [ 7.697959] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.698561] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.699627] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.700103] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.701189] systemd[1]: Starting DHCP Client... gitlab # [ 7.702990] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.705373] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.707962] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.708860] systemd[1]: Finished linger-users.service. gitlab # [ 7.736078] network-addresses-eth1-start[702]: adding address 192.168.1.1/24... done gitlab # [ 7.740954] network-addresses-eth1-start[702]: adding address 2001:db8:1::1/64... done gitlab # [ 7.746335] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.774405] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.775245] systemd[1]: Reached target Network. gitlab # [ 7.776860] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.779228] dhcpcd[713]: dhcpcd-10.3.2 starting gitlab # [ 7.780366] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.781883] dhcpcd[769]: dev: loaded udev gitlab # [ 7.783071] systemd[1]: Starting PostgreSQL Server... gitlab # [ 7.788103] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 7.789125] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.934255] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.934731] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 7.809231] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.811631] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.817024] systemd[1]: Started Getty on tty1. gitlab # [ 7.817696] systemd[1]: Reached target Login Prompts. gitlab # [ 8.041389] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.047457] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.048456] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.050096] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.051010] cfg80211: failed to load regulatory.db gitlab # [ 7.924081] nginx-pre-start[792]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.924795] nginx-pre-start[792]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.930674] systemd[1]: Started Nginx Web Server. gitlab # [ 7.932435] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.934364] postgresql-pre-start[791]: This user must also own the server process. gitlab # [ 8.081679] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.939156] dhcpcd[769]: eth0: waiting for carrier gitlab # [ 7.939903] dhcpcd[769]: eth0: carrier acquired gitlab # [ 7.941149] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.941760] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.942434] postgresql-pre-start[791]: The default text search configuration will be set to "english". gitlab # [ 7.942912] postgresql-pre-start[791]: Data page checksums are enabled. gitlab # [ 7.943579] dhcpcd[769]: DUID 00:01:00:01:32:14:a4:ed:52:54:00:12:34:56 gitlab # [ 7.943819] dhcpcd[769]: eth0: IAID 00:12:34:56 gitlab # [ 7.945266] dhcpcd[769]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.946050] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.946622] postgresql-pre-start[791]: creating subdirectories ... ok gitlab # [ 7.947112] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.950548] redis-server[795]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.951078] redis-server[795]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.951626] redis-server[795]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=795, just started gitlab # [ 7.952035] redis-server[795]: Configuration loaded gitlab # [ 7.952540] redis[795]: monotonic clock: POSIX clock_gettime gitlab # [ 7.952971] redis[795]: Running mode=standalone, port=0. gitlab # [ 7.953888] redis[795]: Server initialized gitlab # [ 7.954943] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.955429] redis[795]: Ready to accept connections unix gitlab # [ 7.956060] redis[795]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.985899] postgresql-pre-start[791]: selecting default "max_connections" ... 100 gitlab # [ 8.022337] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.320250] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.415649] postgresql-pre-start[791]: selecting default time zone ... UTC gitlab # [ 8.417326] postgresql-pre-start[791]: creating configuration files ... ok gitlab # [ 8.538153] gitlab-workhorse[828]: time="2026-08-16T16:42:22Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.538587] gitlab-workhorse[828]: time="2026-08-16T16:42:22Z" level=info msg="Using redis/go-redis" gitlab # [ 8.539507] gitlab-workhorse[828]: time="2026-08-16T16:42:22Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.582328] postgresql-pre-start[791]: running bootstrap script ... ok gitlab # [ 8.993183] dhcpcd[769]: eth0: soliciting a DHCP lease gitlab # [ 9.149662] NET: Registered PF_PACKET protocol family gitlab # [ 9.014856] dhcpcd[769]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 9.022342] dhcpcd[769]: eth0: probing address 10.0.2.15/24 gitlab # [ 9.035274] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok gitlab # [ 9.161780] dhcpcd[769]: eth0: soliciting an IPv6 router gitlab # [ 9.163183] dhcpcd[769]: eth0: Router Advertisement from fe80::2 gitlab # [ 9.164576] dhcpcd[769]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 9.165654] dhcpcd[769]: eth0: adding route to fec0::/64 gitlab # [ 9.166705] dhcpcd[769]: eth0: adding default route via fe80::2 gitlab # [ 9.290422] postgresql-pre-start[791]: syncing data to disk ... ok gitlab # [ 9.291673] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 9.292413] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 9.293518] postgresql-pre-start[791]: Success. You can now start the database server using: gitlab # [ 9.294993] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 9.439704] postgres[854]: [854] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 9.443805] postgres[854]: [854] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 9.445159] postgres[854]: [854] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 9.453111] postgres[854]: [854] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 9.468251] postgres[864]: [864] LOG: database system was shut down at 2026-08-16 16:42:22 GMT gitlab # [ 9.483808] postgres[854]: [854] LOG: database system is ready to accept connections gitlab # [ 9.493627] systemd[1]: Started PostgreSQL Server. gitlab # [ 9.498951] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 9.715336] postgresql-setup-start[875]: CREATE DATABASE gitlab # [ 9.745251] postgresql-setup-start[892]: CREATE ROLE gitlab # [ 9.756375] postgresql-setup-start[896]: ALTER DATABASE gitlab # [ 9.777375] postgresql-setup-start[901]: CREATE ROLE gitlab # [ 9.779750] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[880]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 9.780578] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 9.781844] systemd[1]: Reached target PostgreSQL. gitlab # [ 9.782435] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[880]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 9.783945] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.825813] systemd[1]: Finished gitlab-config.service. gitlab # [ 9.827770] systemd[1]: Started gitaly.service. gitlab # [ 9.829281] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 9.878660] gitlab-postgresql-start[920]: CREATE DATABASE gitlab # [ 9.917592] gitlab-postgresql-start[930]: CREATE EXTENSION gitlab # [ 9.997219] gitlab-postgresql-start[932]: CREATE EXTENSION gitlab # [ 10.001732] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 10.377142] gitaly[923]: time="2026-08-16T16:42:24.285Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=923 gitlab # [ 10.378206] gitaly[923]: time="2026-08-16T16:42:24.285Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=923 gitlab # [ 10.378957] gitaly[923]: time="2026-08-16T16:42:24.285Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=923 gitlab # [ 10.379786] gitaly[923]: time="2026-08-16T16:42:24.286Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=923 gitlab # [ 10.380599] gitaly[923]: time="2026-08-16T16:42:24.286Z" level=info msg="Starting Gitaly" pid=923 version= gitlab # [ 10.572555] gitaly[923]: time="2026-08-16T16:42:24.481Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=193 pid=923 gitlab # [ 10.574408] gitaly[923]: time="2026-08-16T16:42:24.481Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=923 gitlab # [ 10.576108] gitaly[923]: time="2026-08-16T16:42:24.481Z" level=info msg="finished initializing command factory" duration_ms=0 pid=923 gitlab # [ 10.577662] gitaly[923]: time="2026-08-16T16:42:24.481Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-923/git-exec-4074982436.d/git pid=923 gitlab # [ 10.583790] gitaly[923]: time="2026-08-16T16:42:24.492Z" level=info msg="finished detecting git version" duration_ms=10 pid=923 gitlab # [ 10.585432] gitaly[923]: time="2026-08-16T16:42:24.492Z" level=info msg="using Git version" pid=923 version=2.53.g gitlab # [ 10.586934] gitaly[923]: time="2026-08-16T16:42:24.493Z" level=info msg="clearing disk cache object folder" pid=923 storage=default gitlab # [ 10.588626] gitaly[923]: time="2026-08-16T16:42:24.493Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1428016272 pid=923 storage=default gitlab # [ 10.591053] gitaly[923]: time="2026-08-16T16:42:24.493Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1428016272 pid=923 storage=default gitlab # [ 10.593925] gitaly[923]: time="2026-08-16T16:42:24.493Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=923 gitlab # [ 10.596575] gitaly[923]: time="2026-08-16T16:42:24.493Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=923 gitlab # [ 10.599133] gitaly[923]: time="2026-08-16T16:42:24.494Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1428016272 clear_duration_ms=0 pid=923 storage=default gitlab # [ 10.619322] gitaly[923]: time="2026-08-16T16:42:24.527Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=923 gitlab # [ 10.621511] gitaly[923]: time="2026-08-16T16:42:24.527Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=923 schema=unix gitlab # [ 10.623814] gitaly[923]: time="2026-08-16T16:42:24.528Z" level=info msg="listening at address" address=/run/gitaly/gitaly-923/sock.d/intern pid=923 schema=unix gitlab # [ 10.624435] gitaly[923]: time="2026-08-16T16:42:24.528Z" level=info msg="finished tempdir cleaner walk" pid=923 storage=default time_ms=0 gitlab # [ 10.624942] gitaly[923]: time="2026-08-16T16:42:24.527Z" level=info msg="counting repositories" pid=923 gitlab # [ 10.625517] gitaly[923]: time="2026-08-16T16:42:24.528Z" level=info msg="starting to count repositories" pid=923 storage_path=/var/gitlab/state/repositories gitlab # [ 10.625937] gitaly[923]: time="2026-08-16T16:42:24.528Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=923 storage_path=/var/gitlab/state/repositories gitlab # [ 10.626230] gitaly[923]: time="2026-08-16T16:42:24.528Z" level=info msg="completed counting all repositories" counting_duration=0 pid=923 gitlab # [ 10.626750] gitaly[923]: time="2026-08-16T16:42:24.529Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=923 gitlab # [ 10.627414] gitaly[923]: time="2026-08-16T16:42:24.529Z" level=info msg="Started Gitaly" duration_ms=242 pid=923 gitlab # [ 10.627833] gitaly[923]: time="2026-08-16T16:42:24.529Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=923 gitlab # [ 10.628448] gitaly[923]: time="2026-08-16T16:42:24.529Z" level=info msg="maintenance: daily scheduled" pid=923 scheduled="2026-08-17 12:00:00 +0000 UTC" gitlab # [ 11.240332] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.242263] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.269147] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.601759] gitaly[923]: time="2026-08-16T16:42:26.509Z" level=info msg="License database preloaded" duration_ms=2223 pid=923 gitlab # [ 13.815528] dhcpcd[769]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.817326] dhcpcd[769]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.819091] dhcpcd[769]: eth0: adding default route via 10.0.2.2 gitlab # [ 13.941675] systemd[1]: Started DHCP Client. gitlab # [ 13.943765] systemd[1]: Reached target Network is Online. gitlab # [ 42.873895] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: W, [2026-08-16T16:42:56.782355 #926] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 44.794658] postgres[1332]: [1332] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 44.797588] postgres[1332]: [1332] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 44.800367] postgres[1332]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 44.803408] postgres[1332]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 44.806185] postgres[1332]: attidentity AS identity, gitlab # [ 44.807946] postgres[1332]: attgenerated as attgenerated gitlab # [ 44.809930] postgres[1332]: FROM pg_attribute a gitlab # [ 44.811619] postgres[1332]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 44.814558] postgres[1332]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 44.816725] postgres[1332]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 44.819853] postgres[1332]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 44.822102] postgres[1332]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 44.824169] postgres[1332]: ORDER BY a.attnum gitlab # [ 44.825677] postgres[1332]: gitlab # [ 48.605750] gitlab-workhorse[828]: time="2026-08-16T16:43:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 49.037663] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1374]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 49.042260] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1374]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 58.615029] gitlab-workhorse[828]: time="2026-08-16T16:43:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 64.908923] postgres[1449]: [1449] ERROR: relation "table_without_models" does not exist gitlab # [ 64.911747] postgres[1449]: [1449] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.624420] gitlab-workhorse[828]: time="2026-08-16T16:43:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 77.136387] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 77.138108] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 77.139602] systemd[1]: Starting gitlab.service... gitlab # [ 77.527264] bundle[1625]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 77.528556] bundle[1625]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 77.532264] bundle[1625]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 78.626453] gitlab-workhorse[828]: time="2026-08-16T16:43:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 80.292341] sidekiq-cluster[1624]: {"severity":"INFO","time":"2026-08-16T16:43:34.183Z","message":"Starting cluster with 1 processes"} gitlab # [ 80.580224] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.468Z","pid":1625,"message":"* Enabling systemd notification integration"} gitlab # [ 80.581346] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.488Z","pid":1625,"message":"Puma starting in cluster mode..."} gitlab # [ 80.581981] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.488Z","pid":1625,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 80.582629] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.488Z","pid":1625,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 80.583439] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.488Z","pid":1625,"message":"* Min threads: 0"} gitlab # [ 80.584078] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.488Z","pid":1625,"message":"* Max threads: 4"} gitlab # [ 80.584869] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.488Z","pid":1625,"message":"* Environment: production"} gitlab # [ 80.585575] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.488Z","pid":1625,"message":"* Master PID: 1625"} gitlab # [ 80.586240] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.488Z","pid":1625,"message":"* Workers: 2"} gitlab # [ 80.587083] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.488Z","pid":1625,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 80.587716] bundle[1625]: {"timestamp":"2026-08-16T16:43:34.488Z","pid":1625,"message":"* Preloading application"} gitlab # [ 88.635911] gitlab-workhorse[828]: time="2026-08-16T16:43:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.646129] gitlab-workhorse[828]: time="2026-08-16T16:43:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 104.707794] bundle[1625]: W, [2026-08-16T16:43:58.616368 #1625] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 106.891816] sidekiq-cluster[1655]: 2026-08-16T16:44:00.799Z pid=1655 tid=wkf INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1655, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>448245760} gitlab # [ 107.068902] sidekiq-cluster[1655]: W, [2026-08-16T16:44:00.977567 #1655] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 107.111377] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:01.020Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 108.655838] gitlab-workhorse[828]: time="2026-08-16T16:44:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.182848] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.090Z","message":"GitLab reliable fetch activated!"} gitlab # [ 109.184408] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.091Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 109.225844] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.134Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 109.234784] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.143Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 109.244768] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.153Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 109.253981] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.162Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 109.264216] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.173Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 109.273226] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.182Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 109.278199] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.184Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 109.278843] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.186Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 109.288043] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.196Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 109.295893] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.204Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 109.300397] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.209Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 109.306067] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.214Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 109.310721] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.219Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 109.315155] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.224Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 109.319837] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.228Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 109.324334] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.233Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 109.329587] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.238Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 109.333584] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.242Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 109.337307] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.246Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 109.341306] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.250Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 109.345324] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.254Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 109.348747] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.257Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 109.351846] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.260Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 109.354564] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.263Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 109.357488] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.266Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 109.360769] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.269Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 109.363823] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.272Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 109.366829] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.275Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 109.369834] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.278Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 109.372953] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.281Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 109.375805] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.284Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 109.379104] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.288Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 109.382564] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.291Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 109.385736] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.294Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 109.388242] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.297Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 109.390399] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.299Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 109.392483] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.301Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 109.394857] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.303Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 109.397142] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.306Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 109.399401] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.308Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 109.401641] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.310Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 109.403519] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.312Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 109.405625] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.314Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 109.407736] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.316Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 109.410124] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.319Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 109.412626] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.321Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 109.414615] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.323Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 109.416830] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.325Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 109.445533] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.353Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 109.448107] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.357Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 109.451135] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.360Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 109.454307] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.363Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 109.464132] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.373Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 109.467276] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.376Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 109.470692] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.379Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 109.474203] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.383Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 109.476844] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.385Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 109.480401] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.389Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 109.482898] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.391Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 109.486235] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.395Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 109.488896] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.397Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 109.491904] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.400Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 109.494810] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.403Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 109.498285] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.407Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 109.501100] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.410Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 109.504558] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.413Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 109.507262] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.416Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 109.510242] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.419Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 109.512535] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.421Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 109.514829] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.423Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 109.516714] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.425Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 109.519212] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.428Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 109.521183] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.430Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 109.522885] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.431Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 109.525419] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.434Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 109.530292] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.439Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 109.535976] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.444Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 109.537548] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.446Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 109.539564] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.448Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 109.540987] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.450Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 109.542520] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.451Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 109.545123] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.454Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 109.547683] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.456Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 109.549156] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.458Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 109.550568] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.459Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 109.552386] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.461Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 109.554220] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.463Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 109.557053] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.465Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 109.557696] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.466Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 109.559048] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.468Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 109.561049] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.469Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 109.562111] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.471Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 109.563775] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.472Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 109.565215] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.474Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 109.567054] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.476Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 109.570029] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.478Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 109.570870] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.479Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 109.573550] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.481Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 109.580402] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.489Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 109.581936] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.490Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 109.583563] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.492Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 109.585920] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.494Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 109.588064] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.496Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 109.589647] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.498Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 109.592631] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.500Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 109.593107] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.501Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 109.594336] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.503Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 109.596703] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.505Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 109.598864] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:03.506Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 118.666494] gitlab-workhorse[828]: time="2026-08-16T16:44:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 128.667899] gitlab-workhorse[828]: time="2026-08-16T16:44:22Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 131.327341] postgres[2121]: [2121] ERROR: relation "table_without_models" does not exist gitlab # [ 131.329679] postgres[2121]: [2121] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 133.956033] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:27.864Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 133.959352] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:27.867Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 133.961256] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:27.867Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 133.962566] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:27.867Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 133.972228] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:27.881Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 133.986942] bundle[1625]: {"timestamp":"2026-08-16T16:44:27.895Z","pid":1625,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 133.987941] bundle[1625]: {"timestamp":"2026-08-16T16:44:27.895Z","pid":1625,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 133.988596] bundle[1625]: {"timestamp":"2026-08-16T16:44:27.895Z","pid":1625,"message":"! #\u003cThread:0x00007a9a942a3880 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 133.989259] bundle[1625]: {"timestamp":"2026-08-16T16:44:27.895Z","pid":1625,"message":"! #\u003cThread:0x00007a9a94452168 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 133.990253] bundle[1625]: {"timestamp":"2026-08-16T16:44:27.895Z","pid":1625,"message":"Use Ctrl-C to stop"} gitlab # [ 134.012064] bundle[1625]: {"timestamp":"2026-08-16T16:44:27.920Z","pid":1625,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 134.738627] bundle[1625]: {"timestamp":"2026-08-16T16:44:28.647Z","pid":1625,"message":"- Worker 0 (PID: 2179) booted in 0.7s, phase: 0"} gitlab # [ 134.756628] bundle[1625]: {"timestamp":"2026-08-16T16:44:28.665Z","pid":1625,"message":"- Worker 1 (PID: 2183) booted in 0.69s, phase: 0"} gitlab # [ 134.761781] systemd[1]: Started gitlab.service. gitlab # [ 134.762883] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 134.765579] systemd[1]: Starting setup-gitlab.service... gitlab # [ 134.782170] setup-gitlab-start[2207]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 135.646342] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:29.554Z","message":"Cleaning working queues"} gitlab # [ 135.651661] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:29.560Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"9071435f6eb8402b47da75b7","created_at":"2026-08-16T16:43:30.677Z","trace_propagation_headers":{"sentry-trace":"fef8bac682bb453ca80ed6e6120d7d12-24d02065b3c346d2","baggage":"sentry-trace_id=fef8bac682bb453ca80ed6e6120d7d12,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6c0bd4f6e60372d5aeb9a52676143ce7","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T16:43:30.685Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-9071435f6eb8402b47da75b7: start","job_status":"start","queue_duration_s":58.874476,"scheduling_latency_s":58.874623} gitlab # [ 135.853460] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:44:29.761Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"9071435f6eb8402b47da75b7","created_at":"2026-08-16T16:43:30.677Z","trace_propagation_headers":{"sentry-trace":"fef8bac682bb453ca80ed6e6120d7d12-24d02065b3c346d2","baggage":"sentry-trace_id=fef8bac682bb453ca80ed6e6120d7d12,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6c0bd4f6e60372d5aeb9a52676143ce7","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T16:43:30.685Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-9071435f6eb8402b47da75b7: done: 0.202061 sec","job_status":"done","queue_duration_s":58.874476,"scheduling_latency_s":58.874623,"redis_calls":26,"redis_duration_s":0.00717,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003881,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002039,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00125,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.103167023,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.202061,"completed_at":"2026-08-16T16:44:29.761Z","load_balancing_strategy":"primary","db_duration_s":0.066014,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 136.736194] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:44:30 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 1929 gitlab # [ 136.740675] setup-gitlab-start[2207]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 136.743139] setup-gitlab-start[2207]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 136.756157] runuser[2232]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 137.137682] setup-gitlab-start[2233]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 137.139219] setup-gitlab-start[2233]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 137.140244] setup-gitlab-start[2233]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 137.727227] setup-gitlab-start[2233]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 137.729095] setup-gitlab-start[2233]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 137.729705] setup-gitlab-start[2233]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 164.061068] setup-gitlab-start[2233]: W, [2026-08-16T16:44:57.969300 #2233] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 170.910141] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:04.817Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"45c9c657cd5d125d0ec77c91","created_at":"2026-08-16T16:45:04.783Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a26804c043d105c2f44aa91e232ffbf0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T16:45:04.815Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-45c9c657cd5d125d0ec77c91: start","job_status":"start","queue_duration_s":0.002579,"scheduling_latency_s":0.002619} gitlab # [ 171.071305] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:04.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"45c9c657cd5d125d0ec77c91","created_at":"2026-08-16T16:45:04.783Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a26804c043d105c2f44aa91e232ffbf0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T16:45:04.815Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-45c9c657cd5d125d0ec77c91: done: 0.162155 sec","job_status":"done","queue_duration_s":0.002579,"scheduling_latency_s":0.002619,"redis_calls":10,"redis_duration_s":0.005733,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004509,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000631,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000324902,"duration_s":0.162155,"completed_at":"2026-08-16T16:45:04.979Z","load_balancing_strategy":"primary","db_duration_s":0.033032,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.135735] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.044Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f7f870d5fc135c11b71a9a86","created_at":"2026-08-16T16:45:04.875Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b67cabb461bf6cb56d049a3de0c715e5","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:04.944Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f7f870d5fc135c11b71a9a86: start","job_status":"start","queue_duration_s":0.099521,"scheduling_latency_s":0.099579} gitlab # [ 171.234591] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.143Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f7f870d5fc135c11b71a9a86","created_at":"2026-08-16T16:45:04.875Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b67cabb461bf6cb56d049a3de0c715e5","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:04.944Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f7f870d5fc135c11b71a9a86: done: 0.0991 sec","job_status":"done","queue_duration_s":0.099521,"scheduling_latency_s":0.099579,"redis_calls":16,"redis_duration_s":0.015322,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.007645,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00447,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003207,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000973867,"duration_s":0.0991,"completed_at":"2026-08-16T16:45:05.143Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.298082] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.206Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"30136b83608223b0a7e36e08","created_at":"2026-08-16T16:45:04.962Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3be40b19b09eca842150ed81ce9cbd26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:04.977Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-30136b83608223b0a7e36e08: start","job_status":"start","queue_duration_s":0.228884,"scheduling_latency_s":0.228954} gitlab # [ 171.363155] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"30136b83608223b0a7e36e08","created_at":"2026-08-16T16:45:04.962Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3be40b19b09eca842150ed81ce9cbd26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:04.977Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-30136b83608223b0a7e36e08: done: 0.065151 sec","job_status":"done","queue_duration_s":0.228884,"scheduling_latency_s":0.228954,"redis_calls":12,"redis_duration_s":0.010522,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002687,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001156851,"exclusive_lock_hold_duration_s":0.017897248,"duration_s":0.065151,"completed_at":"2026-08-16T16:45:05.271Z","load_balancing_strategy":"primary","db_duration_s":0.011716,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.394185] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"43e254236b4a5ca2175351d3","created_at":"2026-08-16T16:45:05.056Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7b34d19af6c2904fea87a34f8288c28","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.074Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-43e254236b4a5ca2175351d3: start","job_status":"start","queue_duration_s":0.203987,"scheduling_latency_s":0.204026} gitlab # [ 171.426571] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"43e254236b4a5ca2175351d3","created_at":"2026-08-16T16:45:05.056Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7b34d19af6c2904fea87a34f8288c28","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.074Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-43e254236b4a5ca2175351d3: done: 0.056832 sec","job_status":"done","queue_duration_s":0.203987,"scheduling_latency_s":0.204026,"redis_calls":10,"redis_duration_s":0.003049,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000623,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001838,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000593651,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.056832,"completed_at":"2026-08-16T16:45:05.334Z","load_balancing_strategy":"primary","db_duration_s":0.017648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.468690] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3dac4fa7bb2e9f53eed8e30e","created_at":"2026-08-16T16:45:05.085Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3d0c27b2359fc8e65503b3ea3c6e9a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.095Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3dac4fa7bb2e9f53eed8e30e: start","job_status":"start","queue_duration_s":0.281493,"scheduling_latency_s":0.281538} gitlab # [ 171.560365] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3dac4fa7bb2e9f53eed8e30e","created_at":"2026-08-16T16:45:05.085Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3d0c27b2359fc8e65503b3ea3c6e9a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.095Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3dac4fa7bb2e9f53eed8e30e: done: 0.090776 sec","job_status":"done","queue_duration_s":0.281493,"scheduling_latency_s":0.281538,"redis_calls":12,"redis_duration_s":0.036048,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004955,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.029767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000882515,"duration_s":0.090776,"completed_at":"2026-08-16T16:45:05.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.565511] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fd7f468624ed4ff4eca21a49","created_at":"2026-08-16T16:45:05.104Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a90ec8948e6f17c65c76887388b16a4a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T16:45:05.112Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fd7f468624ed4ff4eca21a49: start","job_status":"start","queue_duration_s":0.361387,"scheduling_latency_s":0.361429} gitlab # [ 171.583362] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.492Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 171.590837] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fd7f468624ed4ff4eca21a49","created_at":"2026-08-16T16:45:05.104Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a90ec8948e6f17c65c76887388b16a4a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T16:45:05.112Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fd7f468624ed4ff4eca21a49: done: 0.025643 sec","job_status":"done","queue_duration_s":0.361387,"scheduling_latency_s":0.361429,"redis_calls":10,"redis_duration_s":0.002785,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001678,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000449498,"duration_s":0.025643,"completed_at":"2026-08-16T16:45:05.499Z","load_balancing_strategy":"primary","db_duration_s":0.00064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.632543] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.500Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d0aef8f9ac1006e4e063a6eb","created_at":"2026-08-16T16:45:05.122Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b79e6b8289e45ecd6c22a8be4523a0f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.133Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d0aef8f9ac1006e4e063a6eb: start","job_status":"start","queue_duration_s":0.367047,"scheduling_latency_s":0.367061} gitlab # [ 171.640292] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.526Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d0aef8f9ac1006e4e063a6eb","created_at":"2026-08-16T16:45:05.122Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b79e6b8289e45ecd6c22a8be4523a0f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.133Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d0aef8f9ac1006e4e063a6eb: done: 0.02623 sec","job_status":"done","queue_duration_s":0.367047,"scheduling_latency_s":0.367061,"redis_calls":19,"redis_duration_s":0.003476,"redis_read_bytes":21,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000538,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000405,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002071,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000265956,"duration_s":0.02623,"completed_at":"2026-08-16T16:45:05.526Z","load_balancing_strategy":"primary","db_duration_s":0.001365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.677789] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6a962d9affb7f951208bd24e","created_at":"2026-08-16T16:45:05.200Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28795cd54c90dd8cd5a36345f4959d85","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.225Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6a962d9affb7f951208bd24e: start","job_status":"start","queue_duration_s":0.302506,"scheduling_latency_s":0.30252} gitlab # [ 171.685447] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6a962d9affb7f951208bd24e","created_at":"2026-08-16T16:45:05.200Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28795cd54c90dd8cd5a36345f4959d85","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.225Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6a962d9affb7f951208bd24e: done: 0.027352 sec","job_status":"done","queue_duration_s":0.302506,"scheduling_latency_s":0.30252,"redis_calls":10,"redis_duration_s":0.002592,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000621,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000553422,"duration_s":0.027352,"completed_at":"2026-08-16T16:45:05.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.725643] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e8a374f9577fe7fd218014c6","created_at":"2026-08-16T16:45:05.243Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6273184acdf7389700421ba282cb414","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.256Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e8a374f9577fe7fd218014c6: start","job_status":"start","queue_duration_s":0.300971,"scheduling_latency_s":0.301002} gitlab # [ 171.729638] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.621Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e8a374f9577fe7fd218014c6","created_at":"2026-08-16T16:45:05.243Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6273184acdf7389700421ba282cb414","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.256Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e8a374f9577fe7fd218014c6: done: 0.063911 sec","job_status":"done","queue_duration_s":0.300971,"scheduling_latency_s":0.301002,"redis_calls":14,"redis_duration_s":0.003552,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00074,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000825,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000503136,"exclusive_lock_hold_duration_s":0.03596323,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.063911,"completed_at":"2026-08-16T16:45:05.620Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008544,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.775675] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"dac3e2cbfff0c277e3aa61dc","created_at":"2026-08-16T16:45:05.273Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ab307cb6b57b273653d19b34beb63f0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.375Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-dac3e2cbfff0c277e3aa61dc: start","job_status":"start","queue_duration_s":0.246468,"scheduling_latency_s":0.246483} gitlab # [ 171.776688] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"dac3e2cbfff0c277e3aa61dc","created_at":"2026-08-16T16:45:05.273Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ab307cb6b57b273653d19b34beb63f0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.375Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-dac3e2cbfff0c277e3aa61dc: done: 0.017014 sec","job_status":"done","queue_duration_s":0.246468,"scheduling_latency_s":0.246483,"redis_calls":12,"redis_duration_s":0.001498,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000289701,"exclusive_lock_hold_duration_s":0.0022650920000000002,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.017014,"completed_at":"2026-08-16T16:45:05.639Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.833589] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0ddcc9e6a020c6ab60427e9d","created_at":"2026-08-16T16:45:05.405Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65d4f4ff240557dc4c9cab8c65e64186","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.421Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0ddcc9e6a020c6ab60427e9d: start","job_status":"start","queue_duration_s":0.218273,"scheduling_latency_s":0.218288} gitlab # [ 171.971689] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.879Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0ddcc9e6a020c6ab60427e9d","created_at":"2026-08-16T16:45:05.405Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65d4f4ff240557dc4c9cab8c65e64186","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.421Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0ddcc9e6a020c6ab60427e9d: done: 0.239839 sec","job_status":"done","queue_duration_s":0.218273,"scheduling_latency_s":0.218288,"redis_calls":12,"redis_duration_s":0.003245,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001466,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001537,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.065,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.064,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000333842,"exclusive_lock_hold_duration_s":0.223448511,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.239839,"completed_at":"2026-08-16T16:45:05.879Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.128296,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.991880] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.881Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"09cdd725e24ea93b82d672f5","created_at":"2026-08-16T16:45:05.511Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-9f62316d85a44ead","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0b79e6b8289e45ecd6c22a8be4523a0f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.520Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-09cdd725e24ea93b82d672f5: start","job_status":"start","queue_duration_s":0.360416,"scheduling_latency_s":0.360433} gitlab # [ 171.992537] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.892Z","message":"No existing merge request to be cleaned up."} gitlab # [ 171.995346] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.903Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"09cdd725e24ea93b82d672f5","created_at":"2026-08-16T16:45:05.511Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-9f62316d85a44ead","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0b79e6b8289e45ecd6c22a8be4523a0f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.520Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-09cdd725e24ea93b82d672f5: done: 0.022603 sec","job_status":"done","queue_duration_s":0.360416,"scheduling_latency_s":0.360433,"redis_calls":13,"redis_duration_s":0.002111,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000268749,"duration_s":0.022603,"completed_at":"2026-08-16T16:45:05.903Z","load_balancing_strategy":"primary","db_duration_s":0.002953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.016661] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.905Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"781939a0908537ad4ad3fca1","created_at":"2026-08-16T16:45:05.511Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-9f62316d85a44ead","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0b79e6b8289e45ecd6c22a8be4523a0f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.520Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-781939a0908537ad4ad3fca1: start","job_status":"start","queue_duration_s":0.385025,"scheduling_latency_s":0.38505} gitlab # [ 172.026310] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.914Z","message":"No existing merge request to be cleaned up."} gitlab # [ 172.027864] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.919Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"781939a0908537ad4ad3fca1","created_at":"2026-08-16T16:45:05.511Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-9f62316d85a44ead","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0b79e6b8289e45ecd6c22a8be4523a0f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.520Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-781939a0908537ad4ad3fca1: done: 0.01377 sec","job_status":"done","queue_duration_s":0.385025,"scheduling_latency_s":0.38505,"redis_calls":10,"redis_duration_s":0.0013679999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01377,"completed_at":"2026-08-16T16:45:05.919Z","load_balancing_strategy":"primary","db_duration_s":0.001169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.076986] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.920Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f7944129547a1a8d313e9f02","created_at":"2026-08-16T16:45:05.511Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-9f62316d85a44ead","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0b79e6b8289e45ecd6c22a8be4523a0f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.520Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f7944129547a1a8d313e9f02: start","job_status":"start","queue_duration_s":0.399654,"scheduling_latency_s":0.399669} gitlab # [ 172.077709] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.927Z","message":"No existing merge request to be cleaned up."} gitlab # [ 172.078084] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.932Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f7944129547a1a8d313e9f02","created_at":"2026-08-16T16:45:05.511Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-9f62316d85a44ead","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0b79e6b8289e45ecd6c22a8be4523a0f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.520Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f7944129547a1a8d313e9f02: done: 0.012065 sec","job_status":"done","queue_duration_s":0.399654,"scheduling_latency_s":0.399669,"redis_calls":10,"redis_duration_s":0.001279,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012065,"completed_at":"2026-08-16T16:45:05.932Z","load_balancing_strategy":"primary","db_duration_s":0.000965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.101726] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.933Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e5d5571dee8a123c844b771a","created_at":"2026-08-16T16:45:05.511Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-9f62316d85a44ead","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0b79e6b8289e45ecd6c22a8be4523a0f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.520Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e5d5571dee8a123c844b771a: start","job_status":"start","queue_duration_s":0.412587,"scheduling_latency_s":0.412601} gitlab # [ 172.111580] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.940Z","message":"No existing merge request to be cleaned up."} gitlab # [ 172.112885] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.944Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e5d5571dee8a123c844b771a","created_at":"2026-08-16T16:45:05.511Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-9f62316d85a44ead","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0b79e6b8289e45ecd6c22a8be4523a0f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.520Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e5d5571dee8a123c844b771a: done: 0.011622 sec","job_status":"done","queue_duration_s":0.412587,"scheduling_latency_s":0.412601,"redis_calls":10,"redis_duration_s":0.001317,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000801,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011622,"completed_at":"2026-08-16T16:45:05.944Z","load_balancing_strategy":"primary","db_duration_s":0.000966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.155716] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"997dfcf9ae798bfdf83d770a","created_at":"2026-08-16T16:45:05.461Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffd8f1ea98577a679df1171ac925707f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.679Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-997dfcf9ae798bfdf83d770a: start","job_status":"start","queue_duration_s":0.266489,"scheduling_latency_s":0.266504} gitlab # [ 172.156471] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.953Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 172.157710] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.958Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"997dfcf9ae798bfdf83d770a","created_at":"2026-08-16T16:45:05.461Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffd8f1ea98577a679df1171ac925707f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.679Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-997dfcf9ae798bfdf83d770a: done: 0.012971 sec","job_status":"done","queue_duration_s":0.266489,"scheduling_latency_s":0.266504,"redis_calls":10,"redis_duration_s":0.001267,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022014,"duration_s":0.012971,"completed_at":"2026-08-16T16:45:05.958Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.207186] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"97972acf1daf407523be56e6","created_at":"2026-08-16T16:45:05.688Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"501f642239e51e9b42f5c744e602635d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.697Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-97972acf1daf407523be56e6: start","job_status":"start","queue_duration_s":0.262433,"scheduling_latency_s":0.262446} gitlab # [ 172.207859] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.975Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"97972acf1daf407523be56e6","created_at":"2026-08-16T16:45:05.688Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"501f642239e51e9b42f5c744e602635d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.697Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-97972acf1daf407523be56e6: done: 0.016295 sec","job_status":"done","queue_duration_s":0.262433,"scheduling_latency_s":0.262446,"redis_calls":11,"redis_duration_s":0.001419,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000432,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021986,"duration_s":0.016295,"completed_at":"2026-08-16T16:45:05.975Z","load_balancing_strategy":"primary","db_duration_s":0.001818,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.246616] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.976Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"f28569928ad95bc286bde521","created_at":"2026-08-16T16:45:05.703Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1be14909cb28c87aa4f39121acf8fa39","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.709Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-f28569928ad95bc286bde521: start","job_status":"start","queue_duration_s":0.267639,"scheduling_latency_s":0.267654} gitlab # [ 172.247439] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"f28569928ad95bc286bde521","created_at":"2026-08-16T16:45:05.703Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1be14909cb28c87aa4f39121acf8fa39","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.709Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-f28569928ad95bc286bde521: done: 0.012187 sec","job_status":"done","queue_duration_s":0.267639,"scheduling_latency_s":0.267654,"redis_calls":11,"redis_duration_s":0.001379,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000389,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000202261,"duration_s":0.012187,"completed_at":"2026-08-16T16:45:05.989Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.282027] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"33aa7fc6ecf21b0b042743fc","created_at":"2026-08-16T16:45:05.713Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a688bd396f60504374a99aff4aa02b37","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T16:45:05.719Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-33aa7fc6ecf21b0b042743fc: start","job_status":"start","queue_duration_s":0.270305,"scheduling_latency_s":0.270318} gitlab # [ 172.320938] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:05.998Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 172.321565] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"33aa7fc6ecf21b0b042743fc","created_at":"2026-08-16T16:45:05.713Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a688bd396f60504374a99aff4aa02b37","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T16:45:05.719Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-33aa7fc6ecf21b0b042743fc: done: 0.013625 sec","job_status":"done","queue_duration_s":0.270305,"scheduling_latency_s":0.270318,"redis_calls":10,"redis_duration_s":0.001309,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000236343,"duration_s":0.013625,"completed_at":"2026-08-16T16:45:06.003Z","load_balancing_strategy":"primary","db_duration_s":0.001844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.329158] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.004Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"d0ea750a2f91d3d2de789432","created_at":"2026-08-16T16:45:05.722Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"088f62d2ad601b0de1c2d48c4d1be0d3","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.726Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-d0ea750a2f91d3d2de789432: start","job_status":"start","queue_duration_s":0.277909,"scheduling_latency_s":0.277922} gitlab # [ 172.340223] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"d0ea750a2f91d3d2de789432","created_at":"2026-08-16T16:45:05.722Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"088f62d2ad601b0de1c2d48c4d1be0d3","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.726Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-d0ea750a2f91d3d2de789432: done: 0.02046 sec","job_status":"done","queue_duration_s":0.277909,"scheduling_latency_s":0.277922,"redis_calls":10,"redis_duration_s":0.001279,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021539,"duration_s":0.02046,"completed_at":"2026-08-16T16:45:06.025Z","load_balancing_strategy":"primary","db_duration_s":0.004121,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.394881] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"8447b036bb6f1581167e16ad","created_at":"2026-08-16T16:45:05.738Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2af6236fe8fd012b2f5d81207ef62a06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.743Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-8447b036bb6f1581167e16ad: start","job_status":"start","queue_duration_s":0.282665,"scheduling_latency_s":0.282679} gitlab # [ 172.395639] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.033Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 172.396454] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.038Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"8447b036bb6f1581167e16ad","created_at":"2026-08-16T16:45:05.738Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2af6236fe8fd012b2f5d81207ef62a06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.743Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-8447b036bb6f1581167e16ad: done: 0.012238 sec","job_status":"done","queue_duration_s":0.282665,"scheduling_latency_s":0.282679,"redis_calls":10,"redis_duration_s":0.001239,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224888,"duration_s":0.012238,"completed_at":"2026-08-16T16:45:06.038Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.434311] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.039Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"663e373d5fa81f2a175e3772","created_at":"2026-08-16T16:45:05.754Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5056c0f75ccd184696ebd2061d8dc305","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.759Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-663e373d5fa81f2a175e3772: start","job_status":"start","queue_duration_s":0.279725,"scheduling_latency_s":0.279739} gitlab # [ 172.434971] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"663e373d5fa81f2a175e3772","created_at":"2026-08-16T16:45:05.754Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5056c0f75ccd184696ebd2061d8dc305","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.759Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-663e373d5fa81f2a175e3772: done: 0.013333 sec","job_status":"done","queue_duration_s":0.279725,"scheduling_latency_s":0.279739,"redis_calls":11,"redis_duration_s":0.001486,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000216,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197512,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.013333,"completed_at":"2026-08-16T16:45:06.052Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.484969] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.053Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c750d698f522c2890d9826d3","created_at":"2026-08-16T16:45:05.766Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cbec6e359e47e33845493288b06dff63","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.774Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c750d698f522c2890d9826d3: start","job_status":"start","queue_duration_s":0.278761,"scheduling_latency_s":0.278775} gitlab # [ 172.485618] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c750d698f522c2890d9826d3","created_at":"2026-08-16T16:45:05.766Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cbec6e359e47e33845493288b06dff63","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.774Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c750d698f522c2890d9826d3: done: 0.224836 sec","job_status":"done","queue_duration_s":0.278761,"scheduling_latency_s":0.278775,"redis_calls":565,"redis_duration_s":0.062247000000000004,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.061162,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000256737,"duration_s":0.224836,"completed_at":"2026-08-16T16:45:06.278Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.542239] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a2143c1656633e21acb7efaf","created_at":"2026-08-16T16:45:05.784Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b91998e7c8a279e86e6689a6a4aec214","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.792Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a2143c1656633e21acb7efaf: start","job_status":"start","queue_duration_s":0.487232,"scheduling_latency_s":0.487247} gitlab # [ 172.542925] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a2143c1656633e21acb7efaf","created_at":"2026-08-16T16:45:05.784Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b91998e7c8a279e86e6689a6a4aec214","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.792Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a2143c1656633e21acb7efaf: done: 0.021797 sec","job_status":"done","queue_duration_s":0.487232,"scheduling_latency_s":0.487247,"redis_calls":13,"redis_duration_s":0.001862,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006650566,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.021797,"completed_at":"2026-08-16T16:45:06.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002016,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 172.579712] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.302Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8c40484902087115eeed1907","created_at":"2026-08-16T16:45:05.797Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.802Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8c40484902087115eeed1907: start","job_status":"start","queue_duration_s":0.50008,"scheduling_latency_s":0.500104} gitlab # [ 172.580410] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.368Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8c40484902087115eeed1907","created_at":"2026-08-16T16:45:05.797Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.802Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8c40484902087115eeed1907: done: 0.066077 sec","job_status":"done","queue_duration_s":0.50008,"scheduling_latency_s":0.500104,"redis_calls":71,"redis_duration_s":0.009894,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001205,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000672,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007588,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000240534,"duration_s":0.066077,"completed_at":"2026-08-16T16:45:06.368Z","load_balancing_strategy":"primary","db_duration_s":0.001083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.608126] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.369Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"08927502e7976921665525d5","created_at":"2026-08-16T16:45:05.814Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"474fac70c5c6008f01b111c25cc8f2b5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.821Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-08927502e7976921665525d5: start","job_status":"start","queue_duration_s":0.548137,"scheduling_latency_s":0.548153} gitlab # [ 172.620410] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.395Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"08927502e7976921665525d5","created_at":"2026-08-16T16:45:05.814Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"474fac70c5c6008f01b111c25cc8f2b5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.821Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-08927502e7976921665525d5: done: 0.025354 sec","job_status":"done","queue_duration_s":0.548137,"scheduling_latency_s":0.548153,"redis_calls":12,"redis_duration_s":0.0017620000000000001,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000349765,"exclusive_lock_hold_duration_s":0.008467835,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.025354,"completed_at":"2026-08-16T16:45:06.395Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.678657] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"096dfbf574b6b4275819b676","created_at":"2026-08-16T16:45:05.829Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6f54bd01da1f1ba4aab0bf49c182f0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.836Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-096dfbf574b6b4275819b676: start","job_status":"start","queue_duration_s":0.559564,"scheduling_latency_s":0.559579} gitlab # [ 172.679408] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.405Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 172.680043] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.409Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"096dfbf574b6b4275819b676","created_at":"2026-08-16T16:45:05.829Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6f54bd01da1f1ba4aab0bf49c182f0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.836Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-096dfbf574b6b4275819b676: done: 0.013707 sec","job_status":"done","queue_duration_s":0.559564,"scheduling_latency_s":0.559579,"redis_calls":10,"redis_duration_s":0.001436,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00020701,"duration_s":0.013707,"completed_at":"2026-08-16T16:45:06.409Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.716752] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.410Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"37a9950fe57a19ec2f29da78","created_at":"2026-08-16T16:45:05.843Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03355f718a01cc731e5916db363355ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.850Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-37a9950fe57a19ec2f29da78: start","job_status":"start","queue_duration_s":0.560514,"scheduling_latency_s":0.560528} gitlab # [ 172.717447] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.417Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 172.720755] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.422Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"37a9950fe57a19ec2f29da78","created_at":"2026-08-16T16:45:05.843Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03355f718a01cc731e5916db363355ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.850Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-37a9950fe57a19ec2f29da78: done: 0.011785 sec","job_status":"done","queue_duration_s":0.560514,"scheduling_latency_s":0.560528,"redis_calls":10,"redis_duration_s":0.001282,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200864,"duration_s":0.011785,"completed_at":"2026-08-16T16:45:06.422Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.763642] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.423Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"18c83348f4f04f59096c6249","created_at":"2026-08-16T16:45:05.855Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9450de6755f20c9985cd4f6c1b57dfc4","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.861Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-18c83348f4f04f59096c6249: start","job_status":"start","queue_duration_s":0.561265,"scheduling_latency_s":0.561278} gitlab # [ 172.765110] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.440Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"18c83348f4f04f59096c6249","created_at":"2026-08-16T16:45:05.855Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9450de6755f20c9985cd4f6c1b57dfc4","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.861Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-18c83348f4f04f59096c6249: done: 0.0176 sec","job_status":"done","queue_duration_s":0.561265,"scheduling_latency_s":0.561278,"redis_calls":10,"redis_duration_s":0.001277,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219301,"duration_s":0.0176,"completed_at":"2026-08-16T16:45:06.440Z","load_balancing_strategy":"primary","db_duration_s":0.002272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.832274] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"54351ef3981dd9abffb3e741","created_at":"2026-08-16T16:45:05.870Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36ca50d365a582267bc0a32332e3d7f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.874Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-54351ef3981dd9abffb3e741: start","job_status":"start","queue_duration_s":0.567032,"scheduling_latency_s":0.567046} gitlab # [ 172.832884] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"54351ef3981dd9abffb3e741","created_at":"2026-08-16T16:45:05.870Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-2f40ae976e624d3e","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36ca50d365a582267bc0a32332e3d7f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:05.874Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-54351ef3981dd9abffb3e741: done: 0.011935 sec","job_status":"done","queue_duration_s":0.567032,"scheduling_latency_s":0.567046,"redis_calls":10,"redis_duration_s":0.001276,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201422,"duration_s":0.011935,"completed_at":"2026-08-16T16:45:06.453Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.845130] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa19ffedf150b9bb3f11d6a7","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa19ffedf150b9bb3f11d6a7: start","job_status":"start","queue_duration_s":0.0932,"scheduling_latency_s":0.093213} gitlab # [ 172.890213] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa19ffedf150b9bb3f11d6a7","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa19ffedf150b9bb3f11d6a7: done: 0.014128 sec","job_status":"done","queue_duration_s":0.0932,"scheduling_latency_s":0.093213,"redis_calls":16,"redis_duration_s":0.002064,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201701,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014128,"completed_at":"2026-08-16T16:45:06.469Z","load_balancing_strategy":"primary","db_duration_s":0.00028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.891144] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ba5f0c410f9b3c6e5984fd5","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ba5f0c410f9b3c6e5984fd5: start","job_status":"start","queue_duration_s":0.108336,"scheduling_latency_s":0.10835} gitlab # [ 172.899131] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ba5f0c410f9b3c6e5984fd5","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ba5f0c410f9b3c6e5984fd5: done: 0.009798 sec","job_status":"done","queue_duration_s":0.108336,"scheduling_latency_s":0.10835,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009798,"completed_at":"2026-08-16T16:45:06.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.939474] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c4564c0063d9b8d7e6a6475","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c4564c0063d9b8d7e6a6475: start","job_status":"start","queue_duration_s":0.119113,"scheduling_latency_s":0.119128} gitlab # [ 172.940179] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c4564c0063d9b8d7e6a6475","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c4564c0063d9b8d7e6a6475: done: 0.013839 sec","job_status":"done","queue_duration_s":0.119113,"scheduling_latency_s":0.119128,"redis_calls":13,"redis_duration_s":0.005719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00474,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013839,"completed_at":"2026-08-16T16:45:06.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.985921] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471958e2ff43e391f6f178cb","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471958e2ff43e391f6f178cb: start","job_status":"start","queue_duration_s":0.135734,"scheduling_latency_s":0.135749} gitlab # [ 172.986602] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471958e2ff43e391f6f178cb","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471958e2ff43e391f6f178cb: done: 0.017251 sec","job_status":"done","queue_duration_s":0.135734,"scheduling_latency_s":0.135749,"redis_calls":13,"redis_duration_s":0.007903,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00207,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005833,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017251,"completed_at":"2026-08-16T16:45:06.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.022947] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37a4c996a8628ab2920eabb7","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37a4c996a8628ab2920eabb7: start","job_status":"start","queue_duration_s":0.155534,"scheduling_latency_s":0.155549} gitlab # [ 173.023664] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37a4c996a8628ab2920eabb7","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37a4c996a8628ab2920eabb7: done: 0.017513 sec","job_status":"done","queue_duration_s":0.155534,"scheduling_latency_s":0.155549,"redis_calls":13,"redis_duration_s":0.007944,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002258,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005686,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017513,"completed_at":"2026-08-16T16:45:06.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.082710] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05b1d8bcb00e0c76cfe887ac","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05b1d8bcb00e0c76cfe887ac: start","job_status":"start","queue_duration_s":0.175689,"scheduling_latency_s":0.175704} gitlab # [ 173.083543] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05b1d8bcb00e0c76cfe887ac","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05b1d8bcb00e0c76cfe887ac: done: 0.017907 sec","job_status":"done","queue_duration_s":0.175689,"scheduling_latency_s":0.175704,"redis_calls":13,"redis_duration_s":0.008622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001828,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006794,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017907,"completed_at":"2026-08-16T16:45:06.555Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.097414] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"264715d615ea0ddaa99186d9","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-264715d615ea0ddaa99186d9: start","job_status":"start","queue_duration_s":0.194402,"scheduling_latency_s":0.194417} gitlab # [ 173.132156] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"264715d615ea0ddaa99186d9","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-264715d615ea0ddaa99186d9: done: 0.00971 sec","job_status":"done","queue_duration_s":0.194402,"scheduling_latency_s":0.194417,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00971,"completed_at":"2026-08-16T16:45:06.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.138207] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2552bf7c12241ad17294b21e","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2552bf7c12241ad17294b21e: start","job_status":"start","queue_duration_s":0.204904,"scheduling_latency_s":0.204918} gitlab # [ 173.148540] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2552bf7c12241ad17294b21e","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2552bf7c12241ad17294b21e: done: 0.009489 sec","job_status":"done","queue_duration_s":0.204904,"scheduling_latency_s":0.204918,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009489,"completed_at":"2026-08-16T16:45:06.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.199329] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3477391e3dfe8a15bfb1f371","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3477391e3dfe8a15bfb1f371: start","job_status":"start","queue_duration_s":0.215186,"scheduling_latency_s":0.215199} gitlab # [ 173.200068] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3477391e3dfe8a15bfb1f371","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3477391e3dfe8a15bfb1f371: done: 0.009456 sec","job_status":"done","queue_duration_s":0.215186,"scheduling_latency_s":0.215199,"redis_calls":13,"redis_duration_s":0.0013540000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000451,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009456,"completed_at":"2026-08-16T16:45:06.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.245849] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50f570d2455671f5679c3d5c","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50f570d2455671f5679c3d5c: start","job_status":"start","queue_duration_s":0.225455,"scheduling_latency_s":0.225469} gitlab # [ 173.246666] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50f570d2455671f5679c3d5c","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50f570d2455671f5679c3d5c: done: 0.012601 sec","job_status":"done","queue_duration_s":0.225455,"scheduling_latency_s":0.225469,"redis_calls":13,"redis_duration_s":0.001388,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000447,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012601,"completed_at":"2026-08-16T16:45:06.599Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.292286] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d8cf1f4f5a1a3f06e9f870e","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d8cf1f4f5a1a3f06e9f870e: start","job_status":"start","queue_duration_s":0.238854,"scheduling_latency_s":0.238866} gitlab # [ 173.292951] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d8cf1f4f5a1a3f06e9f870e","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d8cf1f4f5a1a3f06e9f870e: done: 0.009421 sec","job_status":"done","queue_duration_s":0.238854,"scheduling_latency_s":0.238866,"redis_calls":13,"redis_duration_s":0.0013210000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000437,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009421,"completed_at":"2026-08-16T16:45:06.609Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.303057] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d831107e85ae36a844e15c39","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d831107e85ae36a844e15c39: start","job_status":"start","queue_duration_s":0.249222,"scheduling_latency_s":0.249235} gitlab # [ 173.342741] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d831107e85ae36a844e15c39","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d831107e85ae36a844e15c39: done: 0.00938 sec","job_status":"done","queue_duration_s":0.249222,"scheduling_latency_s":0.249235,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000453,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00938,"completed_at":"2026-08-16T16:45:06.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.344223] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c630569d67d79b154a269c89","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c630569d67d79b154a269c89: start","job_status":"start","queue_duration_s":0.259544,"scheduling_latency_s":0.259557} gitlab # [ 173.354573] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c630569d67d79b154a269c89","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c630569d67d79b154a269c89: done: 0.016448 sec","job_status":"done","queue_duration_s":0.259544,"scheduling_latency_s":0.259557,"redis_calls":13,"redis_duration_s":0.00827,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016448,"completed_at":"2026-08-16T16:45:06.637Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.403712] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"498edae00a5cbdcd4c855430","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-498edae00a5cbdcd4c855430: start","job_status":"start","queue_duration_s":0.276973,"scheduling_latency_s":0.276989} gitlab # [ 173.404574] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"498edae00a5cbdcd4c855430","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-498edae00a5cbdcd4c855430: done: 0.009343 sec","job_status":"done","queue_duration_s":0.276973,"scheduling_latency_s":0.276989,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000446,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009343,"completed_at":"2026-08-16T16:45:06.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.460658] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d2da1e73677a2dbabe401d3","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d2da1e73677a2dbabe401d3: start","job_status":"start","queue_duration_s":0.287256,"scheduling_latency_s":0.28727} gitlab # [ 173.461526] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d2da1e73677a2dbabe401d3","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d2da1e73677a2dbabe401d3: done: 0.009201 sec","job_status":"done","queue_duration_s":0.287256,"scheduling_latency_s":0.28727,"redis_calls":13,"redis_duration_s":0.001346,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009201,"completed_at":"2026-08-16T16:45:06.658Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.498156] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b2d93ff3b0ad6dbd873b6ad","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b2d93ff3b0ad6dbd873b6ad: start","job_status":"start","queue_duration_s":0.297398,"scheduling_latency_s":0.297412} gitlab # [ 173.498850] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b2d93ff3b0ad6dbd873b6ad","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b2d93ff3b0ad6dbd873b6ad: done: 0.009261 sec","job_status":"done","queue_duration_s":0.297398,"scheduling_latency_s":0.297412,"redis_calls":13,"redis_duration_s":0.001466,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009261,"completed_at":"2026-08-16T16:45:06.668Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.511717] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b922b674fde6b9243b2158c0","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b922b674fde6b9243b2158c0: start","job_status":"start","queue_duration_s":0.307524,"scheduling_latency_s":0.307537} gitlab # [ 173.521942] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b922b674fde6b9243b2158c0","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b922b674fde6b9243b2158c0: done: 0.019578 sec","job_status":"done","queue_duration_s":0.307524,"scheduling_latency_s":0.307537,"redis_calls":13,"redis_duration_s":0.011224,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002239,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019578,"completed_at":"2026-08-16T16:45:06.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.571654] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47efb0f7a33982c126a76d90","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47efb0f7a33982c126a76d90: start","job_status":"start","queue_duration_s":0.329675,"scheduling_latency_s":0.329691} gitlab # [ 173.572425] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47efb0f7a33982c126a76d90","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47efb0f7a33982c126a76d90: done: 0.017376 sec","job_status":"done","queue_duration_s":0.329675,"scheduling_latency_s":0.329691,"redis_calls":13,"redis_duration_s":0.008344,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001774,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00657,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017376,"completed_at":"2026-08-16T16:45:06.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.594625] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7570be6f8a0e31f19ad540a7","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7570be6f8a0e31f19ad540a7: start","job_status":"start","queue_duration_s":0.347871,"scheduling_latency_s":0.347885} gitlab # [ 173.633489] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7570be6f8a0e31f19ad540a7","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7570be6f8a0e31f19ad540a7: done: 0.009796 sec","job_status":"done","queue_duration_s":0.347871,"scheduling_latency_s":0.347885,"redis_calls":13,"redis_duration_s":0.001941,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009796,"completed_at":"2026-08-16T16:45:06.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.635623] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a9a1ae1851458441199c825","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a9a1ae1851458441199c825: start","job_status":"start","queue_duration_s":0.35848,"scheduling_latency_s":0.358495} gitlab # [ 173.678528] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a9a1ae1851458441199c825","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a9a1ae1851458441199c825: done: 0.009421 sec","job_status":"done","queue_duration_s":0.35848,"scheduling_latency_s":0.358495,"redis_calls":13,"redis_duration_s":0.001374,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000451,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009421,"completed_at":"2026-08-16T16:45:06.729Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.679572] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01d69b0715d6cbf0a0d11dbb","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01d69b0715d6cbf0a0d11dbb: start","job_status":"start","queue_duration_s":0.368848,"scheduling_latency_s":0.368861} gitlab # [ 173.716766] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01d69b0715d6cbf0a0d11dbb","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01d69b0715d6cbf0a0d11dbb: done: 0.009406 sec","job_status":"done","queue_duration_s":0.368848,"scheduling_latency_s":0.368861,"redis_calls":13,"redis_duration_s":0.00136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009406,"completed_at":"2026-08-16T16:45:06.739Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.719073] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e57a9c8c14048950549fb62","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e57a9c8c14048950549fb62: start","job_status":"start","queue_duration_s":0.38263,"scheduling_latency_s":0.382647} gitlab # [ 173.729222] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e57a9c8c14048950549fb62","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e57a9c8c14048950549fb62: done: 0.009978 sec","job_status":"done","queue_duration_s":0.38263,"scheduling_latency_s":0.382647,"redis_calls":13,"redis_duration_s":0.0015570000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009978,"completed_at":"2026-08-16T16:45:06.754Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.791760] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cc27299d41a1d4ed1a769f4","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cc27299d41a1d4ed1a769f4: start","job_status":"start","queue_duration_s":0.393621,"scheduling_latency_s":0.393634} gitlab # [ 173.792545] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cc27299d41a1d4ed1a769f4","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cc27299d41a1d4ed1a769f4: done: 0.009673 sec","job_status":"done","queue_duration_s":0.393621,"scheduling_latency_s":0.393634,"redis_calls":13,"redis_duration_s":0.001536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009673,"completed_at":"2026-08-16T16:45:06.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.802614] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57d3d92e16e398c7ce4bce8c","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57d3d92e16e398c7ce4bce8c: start","job_status":"start","queue_duration_s":0.404282,"scheduling_latency_s":0.404297} gitlab # [ 173.842294] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57d3d92e16e398c7ce4bce8c","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57d3d92e16e398c7ce4bce8c: done: 0.009599 sec","job_status":"done","queue_duration_s":0.404282,"scheduling_latency_s":0.404297,"redis_calls":13,"redis_duration_s":0.001504,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009599,"completed_at":"2026-08-16T16:45:06.775Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.843234] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bba68f581978e54c70cb27fe","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bba68f581978e54c70cb27fe: start","job_status":"start","queue_duration_s":0.414874,"scheduling_latency_s":0.414888} gitlab # [ 173.853159] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bba68f581978e54c70cb27fe","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bba68f581978e54c70cb27fe: done: 0.009672 sec","job_status":"done","queue_duration_s":0.414874,"scheduling_latency_s":0.414888,"redis_calls":13,"redis_duration_s":0.00158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009672,"completed_at":"2026-08-16T16:45:06.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.887638] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"013c655701e7e8e646e05772","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-013c655701e7e8e646e05772: start","job_status":"start","queue_duration_s":0.425557,"scheduling_latency_s":0.425571} gitlab # [ 173.923737] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"013c655701e7e8e646e05772","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-013c655701e7e8e646e05772: done: 0.009638 sec","job_status":"done","queue_duration_s":0.425557,"scheduling_latency_s":0.425571,"redis_calls":13,"redis_duration_s":0.001554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009638,"completed_at":"2026-08-16T16:45:06.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.924900] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95c764214e578490db1c4db0","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95c764214e578490db1c4db0: start","job_status":"start","queue_duration_s":0.436223,"scheduling_latency_s":0.436237} gitlab # [ 173.935111] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95c764214e578490db1c4db0","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95c764214e578490db1c4db0: done: 0.009595 sec","job_status":"done","queue_duration_s":0.436223,"scheduling_latency_s":0.436237,"redis_calls":13,"redis_duration_s":0.0015469999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009595,"completed_at":"2026-08-16T16:45:06.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.967246] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39afabc2f17d5a2650811826","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39afabc2f17d5a2650811826: start","job_status":"start","queue_duration_s":0.446663,"scheduling_latency_s":0.446677} gitlab # [ 174.009982] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39afabc2f17d5a2650811826","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39afabc2f17d5a2650811826: done: 0.009686 sec","job_status":"done","queue_duration_s":0.446663,"scheduling_latency_s":0.446677,"redis_calls":13,"redis_duration_s":0.001577,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009686,"completed_at":"2026-08-16T16:45:06.818Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.010881] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bdb3f00f2e80fecb3f5ac4a","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bdb3f00f2e80fecb3f5ac4a: start","job_status":"start","queue_duration_s":0.457202,"scheduling_latency_s":0.457217} gitlab # [ 174.018175] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bdb3f00f2e80fecb3f5ac4a","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bdb3f00f2e80fecb3f5ac4a: done: 0.009722 sec","job_status":"done","queue_duration_s":0.457202,"scheduling_latency_s":0.457217,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009722,"completed_at":"2026-08-16T16:45:06.828Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.078647] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"431b43910e9f4c6ac160d481","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-431b43910e9f4c6ac160d481: start","job_status":"start","queue_duration_s":0.467781,"scheduling_latency_s":0.467794} gitlab # [ 174.079225] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"431b43910e9f4c6ac160d481","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-431b43910e9f4c6ac160d481: done: 0.010098 sec","job_status":"done","queue_duration_s":0.467781,"scheduling_latency_s":0.467794,"redis_calls":13,"redis_duration_s":0.001681,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010098,"completed_at":"2026-08-16T16:45:06.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.090700] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbac606d5aeceb7ef4cbee9c","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbac606d5aeceb7ef4cbee9c: start","job_status":"start","queue_duration_s":0.478769,"scheduling_latency_s":0.478784} gitlab # [ 174.100829] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbac606d5aeceb7ef4cbee9c","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbac606d5aeceb7ef4cbee9c: done: 0.009838 sec","job_status":"done","queue_duration_s":0.478769,"scheduling_latency_s":0.478784,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009838,"completed_at":"2026-08-16T16:45:06.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.154680] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65b903f30f539ce1c926dcf2","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65b903f30f539ce1c926dcf2: start","job_status":"start","queue_duration_s":0.489415,"scheduling_latency_s":0.489451} gitlab # [ 174.155357] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65b903f30f539ce1c926dcf2","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65b903f30f539ce1c926dcf2: done: 0.009611 sec","job_status":"done","queue_duration_s":0.489415,"scheduling_latency_s":0.489451,"redis_calls":13,"redis_duration_s":0.001573,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009611,"completed_at":"2026-08-16T16:45:06.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.194082] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78cfa36fbb7a5806dd9c6c80","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78cfa36fbb7a5806dd9c6c80: start","job_status":"start","queue_duration_s":0.500054,"scheduling_latency_s":0.500069} gitlab # [ 174.194759] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78cfa36fbb7a5806dd9c6c80","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78cfa36fbb7a5806dd9c6c80: done: 0.010159 sec","job_status":"done","queue_duration_s":0.500054,"scheduling_latency_s":0.500069,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010159,"completed_at":"2026-08-16T16:45:06.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.231783] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d51bdc520eafacd10380ee9","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d51bdc520eafacd10380ee9: start","job_status":"start","queue_duration_s":0.511214,"scheduling_latency_s":0.511229} gitlab # [ 174.232644] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d51bdc520eafacd10380ee9","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d51bdc520eafacd10380ee9: done: 0.009763 sec","job_status":"done","queue_duration_s":0.511214,"scheduling_latency_s":0.511229,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009763,"completed_at":"2026-08-16T16:45:06.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.254512] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66bf718bbbe76670eeee3b18","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66bf718bbbe76670eeee3b18: start","job_status":"start","queue_duration_s":0.521996,"scheduling_latency_s":0.522011} gitlab # [ 174.264641] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66bf718bbbe76670eeee3b18","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66bf718bbbe76670eeee3b18: done: 0.009642 sec","job_status":"done","queue_duration_s":0.521996,"scheduling_latency_s":0.522011,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009642,"completed_at":"2026-08-16T16:45:06.893Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.299946] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7f51c463a58156d39153148","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7f51c463a58156d39153148: start","job_status":"start","queue_duration_s":0.532644,"scheduling_latency_s":0.532658} gitlab # [ 174.305690] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7f51c463a58156d39153148","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7f51c463a58156d39153148: done: 0.009673 sec","job_status":"done","queue_duration_s":0.532644,"scheduling_latency_s":0.532658,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009673,"completed_at":"2026-08-16T16:45:06.903Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.342550] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31ab7e80ab938fcd02ba7fe9","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31ab7e80ab938fcd02ba7fe9: start","job_status":"start","queue_duration_s":0.543356,"scheduling_latency_s":0.543372} gitlab # [ 174.346546] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31ab7e80ab938fcd02ba7fe9","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31ab7e80ab938fcd02ba7fe9: done: 0.009676 sec","job_status":"done","queue_duration_s":0.543356,"scheduling_latency_s":0.543372,"redis_calls":13,"redis_duration_s":0.001593,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009676,"completed_at":"2026-08-16T16:45:06.914Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.378303] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31c44ecf7c7726a1bb70efe3","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31c44ecf7c7726a1bb70efe3: start","job_status":"start","queue_duration_s":0.553875,"scheduling_latency_s":0.553888} gitlab # [ 174.388788] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31c44ecf7c7726a1bb70efe3","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31c44ecf7c7726a1bb70efe3: done: 0.009639 sec","job_status":"done","queue_duration_s":0.553875,"scheduling_latency_s":0.553888,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009639,"completed_at":"2026-08-16T16:45:06.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.446592] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5097c1184d2ef50edb18e44","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5097c1184d2ef50edb18e44: start","job_status":"start","queue_duration_s":0.564349,"scheduling_latency_s":0.564362} gitlab # [ 174.447295] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5097c1184d2ef50edb18e44","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5097c1184d2ef50edb18e44: done: 0.013155 sec","job_status":"done","queue_duration_s":0.564349,"scheduling_latency_s":0.564362,"redis_calls":13,"redis_duration_s":0.004732999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004251,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013155,"completed_at":"2026-08-16T16:45:06.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.462581] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afcb1b0d9ac030d3dc9ae693","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afcb1b0d9ac030d3dc9ae693: start","job_status":"start","queue_duration_s":0.578345,"scheduling_latency_s":0.57836} gitlab # [ 174.500708] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afcb1b0d9ac030d3dc9ae693","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afcb1b0d9ac030d3dc9ae693: done: 0.009791 sec","job_status":"done","queue_duration_s":0.578345,"scheduling_latency_s":0.57836,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009791,"completed_at":"2026-08-16T16:45:06.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.503630] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522a4d1bbc00af41938a9fb9","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522a4d1bbc00af41938a9fb9: start","job_status":"start","queue_duration_s":0.588985,"scheduling_latency_s":0.588999} gitlab # [ 174.513754] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522a4d1bbc00af41938a9fb9","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522a4d1bbc00af41938a9fb9: done: 0.010322 sec","job_status":"done","queue_duration_s":0.588985,"scheduling_latency_s":0.588999,"redis_calls":13,"redis_duration_s":0.002056,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010322,"completed_at":"2026-08-16T16:45:06.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.548886] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"892ede77086e30b656a7fe13","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-892ede77086e30b656a7fe13: start","job_status":"start","queue_duration_s":0.600198,"scheduling_latency_s":0.600211} gitlab # [ 174.586816] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"892ede77086e30b656a7fe13","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-892ede77086e30b656a7fe13: done: 0.009634 sec","job_status":"done","queue_duration_s":0.600198,"scheduling_latency_s":0.600211,"redis_calls":13,"redis_duration_s":0.0015210000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009634,"completed_at":"2026-08-16T16:45:06.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.587897] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13478d2060704b9b35dce237","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13478d2060704b9b35dce237: start","job_status":"start","queue_duration_s":0.610683,"scheduling_latency_s":0.610698} gitlab # [ 174.596759] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13478d2060704b9b35dce237","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13478d2060704b9b35dce237: done: 0.009538 sec","job_status":"done","queue_duration_s":0.610683,"scheduling_latency_s":0.610698,"redis_calls":13,"redis_duration_s":0.001671,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000655,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009538,"completed_at":"2026-08-16T16:45:06.981Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.633687] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abde149a98bd6569a7c328bc","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abde149a98bd6569a7c328bc: start","job_status":"start","queue_duration_s":0.621215,"scheduling_latency_s":0.621229} gitlab # [ 174.637656] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abde149a98bd6569a7c328bc","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abde149a98bd6569a7c328bc: done: 0.009608 sec","job_status":"done","queue_duration_s":0.621215,"scheduling_latency_s":0.621229,"redis_calls":13,"redis_duration_s":0.00156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009608,"completed_at":"2026-08-16T16:45:06.992Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.697707] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:06.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3276f97c845a52d103c4c83a","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3276f97c845a52d103c4c83a: start","job_status":"start","queue_duration_s":0.631867,"scheduling_latency_s":0.631881} gitlab # [ 174.698547] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3276f97c845a52d103c4c83a","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3276f97c845a52d103c4c83a: done: 0.009581 sec","job_status":"done","queue_duration_s":0.631867,"scheduling_latency_s":0.631881,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009581,"completed_at":"2026-08-16T16:45:07.003Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.738166] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91d50a57e6cd37e30a1d008c","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91d50a57e6cd37e30a1d008c: start","job_status":"start","queue_duration_s":0.642502,"scheduling_latency_s":0.642516} gitlab # [ 174.738871] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91d50a57e6cd37e30a1d008c","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91d50a57e6cd37e30a1d008c: done: 0.009636 sec","job_status":"done","queue_duration_s":0.642502,"scheduling_latency_s":0.642516,"redis_calls":13,"redis_duration_s":0.0015069999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009636,"completed_at":"2026-08-16T16:45:07.013Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.751765] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b4d45b6648d504e9f266fd7","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b4d45b6648d504e9f266fd7: start","job_status":"start","queue_duration_s":0.653128,"scheduling_latency_s":0.653142} gitlab # [ 174.761937] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b4d45b6648d504e9f266fd7","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b4d45b6648d504e9f266fd7: done: 0.009596 sec","job_status":"done","queue_duration_s":0.653128,"scheduling_latency_s":0.653142,"redis_calls":13,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009596,"completed_at":"2026-08-16T16:45:07.024Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.812071] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c65fb4ec2e82601235521422","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c65fb4ec2e82601235521422: start","job_status":"start","queue_duration_s":0.663783,"scheduling_latency_s":0.663798} gitlab # [ 174.812748] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c65fb4ec2e82601235521422","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c65fb4ec2e82601235521422: done: 0.009821 sec","job_status":"done","queue_duration_s":0.663783,"scheduling_latency_s":0.663798,"redis_calls":13,"redis_duration_s":0.001789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001289,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009821,"completed_at":"2026-08-16T16:45:07.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.862681] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43479f8b7ebfbf9c447cdffe","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43479f8b7ebfbf9c447cdffe: start","job_status":"start","queue_duration_s":0.674414,"scheduling_latency_s":0.674454} gitlab # [ 174.863602] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43479f8b7ebfbf9c447cdffe","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43479f8b7ebfbf9c447cdffe: done: 0.009834 sec","job_status":"done","queue_duration_s":0.674414,"scheduling_latency_s":0.674454,"redis_calls":13,"redis_duration_s":0.0016480000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009834,"completed_at":"2026-08-16T16:45:07.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.876838] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14c638f58776d6973352c2b9","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14c638f58776d6973352c2b9: start","job_status":"start","queue_duration_s":0.685146,"scheduling_latency_s":0.685158} gitlab # [ 174.887076] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:07.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14c638f58776d6973352c2b9","created_at":"2026-08-16T16:45:06.314Z","trace_propagation_headers":{"sentry-trace":"8679b97224c74f18bf0376a1274de6e4-7a0b36ec6aba4cb6","baggage":"sentry-trace_id=8679b97224c74f18bf0376a1274de6e4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"313f87034cea02668d6052504a333b30","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:06.361Z","job_size_bytes":2,"pid":1655,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14c638f58776d6973352c2b9: done: 0.009655 sec","job_status":"done","queue_duration_s":0.685146,"scheduling_latency_s":0.685158,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009655,"completed_at":"2026-08-16T16:45:07.056Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.097659] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2666077333 wd_nsec: 2666077382 gitlab # [ 187.410721] postgres[2437]: [2437] ERROR: relation "table_without_models" does not exist gitlab # [ 187.413823] postgres[2437]: [2437] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 191.078556] runuser[2232]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 191.082132] setup-gitlab-start[2207]: + systemctl restart gitlab-sidekiq.service gitlab # [ 191.103388] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 191.105813] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:25.012Z","message":"Shutting down"} gitlab # [ 191.107206] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:25.014Z","message":"Scheduler exiting..."} gitlab # [ 191.108461] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:25.014Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 191.114741] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:25.023Z","message":"Scheduler exiting..."} gitlab # [ 191.618897] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:25.527Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 193.623684] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:27.531Z","message":"Bye!"} gitlab # [ 193.655231] sidekiq-cluster[1655]: {"severity":"INFO","time":"2026-08-16T16:45:27.563Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1655,"worker_id":"sidekiq_0","memwd_rss_bytes":963387392,"retry":0} gitlab # [ 195.328192] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 195.330825] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 195.332684] systemd[1]: gitlab-sidekiq.service: Consumed 59.835s CPU time over 1min 58.189s wall clock time, 972.3M memory peak, 4.4M read from disk. gitlab # [ 195.337316] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 195.339732] setup-gitlab-start[2207]: + mkdir -p /var/lib/secrets gitlab # [ 195.341828] setup-gitlab-start[2207]: + echo nixbot-test-token-of-20-chars gitlab # [ 195.343967] setup-gitlab-start[2207]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 195.346360] setup-gitlab-start[2207]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 197.339227] gitaly[923]: time="2026-08-16T16:45:31.246Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.246" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.341435] gitaly[923]: time="2026-08-16T16:45:31.247Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.246" grpc.time_ms=0.49 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.495082] gitaly[923]: time="2026-08-16T16:45:31.404Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.162" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.403" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.515902] gitaly[923]: time="2026-08-16T16:45:31.424Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.162" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.403" grpc.time_ms=0.471 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.597183] gitaly[923]: time="2026-08-16T16:45:31.505Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ diskcache=bcd33666-d42d-480f-ac23-4cbe34bb1d7c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T16:45:41.206" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.447" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.620739] gitaly[923]: time="2026-08-16T16:45:31.506Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1577 command.oublock=32 command.real_time_ms=26 command.spawn_token_fork_ms=1 command.system_time_ms=19 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T16:45:41.206" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.447" grpc.time_ms=58.583 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.644616] gitaly[923]: time="2026-08-16T16:45:31.521Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.280" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.520" pid=923 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 197.645970] gitaly[923]: time="2026-08-16T16:45:31.521Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.280" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.520" grpc.time_ms=0.628 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.649611] gitaly[923]: time="2026-08-16T16:45:31.536Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:45:41.285" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.525" grpc.time_ms=11.096 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.682053] gitaly[923]: time="2026-08-16T16:45:31.590Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.590" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.685100] gitaly[923]: time="2026-08-16T16:45:31.592Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.590" grpc.time_ms=1.535 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.729738] gitaly[923]: time="2026-08-16T16:45:31.638Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ diskcache=b707e536-a1cd-4a4f-8875-bf895ca973e2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T16:45:41.014" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.595" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.738622] gitaly[923]: time="2026-08-16T16:45:31.647Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1579 command.oublock=32 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T16:45:41.014" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.595" grpc.time_ms=43.63 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.756556] gitaly[923]: time="2026-08-16T16:45:31.665Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.084" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.665" pid=923 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 197.757787] gitaly[923]: time="2026-08-16T16:45:31.665Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.084" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.665" grpc.time_ms=0.436 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.787447] gitaly[923]: time="2026-08-16T16:45:31.696Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:45:41.105" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.686" grpc.time_ms=9.747 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.836710] gitaly[923]: time="2026-08-16T16:45:31.745Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:45:41.164" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.745" grpc.time_ms=0.189 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.844826] gitaly[923]: time="2026-08-16T16:45:31.753Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T16:45:41.172" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:31.753" grpc.time_ms=0.427 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.537183] gitaly[923]: time="2026-08-16T16:45:32.445Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDJ9M0CNXFXAQTF6ARGVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:45:42.193" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:32.433" grpc.time_ms=11.591 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.540124] sidekiq-cluster[2484]: {"severity":"INFO","time":"2026-08-16T16:45:32.431Z","message":"Starting cluster with 1 processes"} gitlab # [ 198.817109] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:32 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 3455 gitlab # [ 198.821696] setup-gitlab-start[2207]: + mkdir -p /tmp/test-flake gitlab # [ 198.823844] setup-gitlab-start[2207]: + cd /tmp/test-flake gitlab # [ 198.825510] setup-gitlab-start[2207]: + git init -b master gitlab # [ 198.841236] setup-gitlab-start[2544]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 198.843878] setup-gitlab-start[2207]: + git config user.name test gitlab # [ 198.845840] setup-gitlab-start[2207]: + git config user.email test@example.com gitlab # [ 198.848071] setup-gitlab-start[2207]: + cat gitlab # [ 198.849451] setup-gitlab-start[2207]: + git add flake.nix gitlab # [ 198.851170] setup-gitlab-start[2207]: + git commit -m 'initial commit' gitlab # [ 198.869785] setup-gitlab-start[2549]: [master (root-commit) f48ee74] initial commit gitlab # [ 198.871311] setup-gitlab-start[2549]: 1 file changed, 10 insertions(+) gitlab # [ 198.872886] setup-gitlab-start[2549]: create mode 100644 flake.nix gitlab # [ 198.874437] setup-gitlab-start[2207]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 198.876175] setup-gitlab-start[2207]: + git push -u origin master gitlab # [ 198.947764] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:32 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 42 gitlab # [ 199.051716] gitaly[923]: time="2026-08-16T16:45:32.960Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNSXB0C1DEN3V7BP8AXS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:32.947" grpc.time_ms=12.873 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 199.079947] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:32 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 126 gitlab # [ 199.318414] gitaly[923]: time="2026-08-16T16:45:33.227Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:45:43.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:33.216" grpc.time_ms=10.085 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.390923] gitaly[923]: time="2026-08-16T16:45:33.299Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=332 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T16:46:03.086" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T16:45:33.287" grpc.time_ms=12.291 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.416683] gitaly[923]: time="2026-08-16T16:45:33.325Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05QDNYDM379Q5R1CEFAA8SW duration_ms=182ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 199.591750] gitaly[923]: time="2026-08-16T16:45:33.499Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05QDNYDM379Q5R1CEFAA8SW duration_ms=173ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 199.593366] gitaly[923]: time="2026-08-16T16:45:33.500Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:33.142" grpc.time_ms=357.845 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 199.651224] gitaly[923]: time="2026-08-16T16:45:33.560Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:33.559" grpc.time_ms=0.511 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 199.698867] gitaly[923]: time="2026-08-16T16:45:33.607Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:33.606" grpc.time_ms=0.804 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 199.750076] gitaly[923]: time="2026-08-16T16:45:33.658Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:33.658" grpc.time_ms=0.383 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 199.881614] gitaly[923]: time="2026-08-16T16:45:33.790Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:45:43.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:33.779" grpc.time_ms=10.859 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.925894] gitaly[923]: time="2026-08-16T16:45:33.834Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1566 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T16:45:43.043" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:45:33.813" grpc.time_ms=20.83 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.941555] gitaly[923]: time="2026-08-16T16:45:33.850Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05QDNYDM379Q5R1CEFAA8SW duration_ms=162ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 199.943093] gitaly[923]: time="2026-08-16T16:45:33.851Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:33.687" grpc.time_ms=163.443 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 199.968699] gitaly[923]: time="2026-08-16T16:45:33.877Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW diskcache=3ae40513-5616-4eb1-8991-5fe2db4b4ea4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:33.058" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 199.977247] gitaly[923]: time="2026-08-16T16:45:33.886Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=233 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13377 command.oublock=32 command.real_time_ms=808 command.spawn_token_fork_ms=0 command.system_time_ms=153 command.user_time_ms=80 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:33.058" grpc.time_ms=819.177 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 199.979104] gitlab-workhorse[828]: time="2026-08-16T16:45:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 199.979829] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:33 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 881 gitlab # [ 199.993823] setup-gitlab-start[2553]: To http://gitlab/root/test-flake.git gitlab # [ 199.994834] setup-gitlab-start[2553]: * [new branch] master -> master gitlab # [ 200.000406] setup-gitlab-start[2553]: branch 'master' set up to track 'origin/master'. gitlab # [ 200.004954] systemd[1]: Finished setup-gitlab.service. gitlab # [ 200.011178] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 201.48 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 201.251306] nixbot[2639]: {"ts": "2026-08-16T16:45:35.159Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 201.275914] nixbot[2639]: {"ts": "2026-08-16T16:45:35.184Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 201.311087] nixbot[2639]: {"ts": "2026-08-16T16:45:35.219Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 201.322314] nixbot[2639]: {"ts": "2026-08-16T16:45:35.231Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 201.334457] nixbot[2639]: {"ts": "2026-08-16T16:45:35.243Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 201.348147] nixbot[2639]: {"ts": "2026-08-16T16:45:35.256Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 201.359604] nixbot[2639]: {"ts": "2026-08-16T16:45:35.268Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 201.367526] nixbot[2639]: {"ts": "2026-08-16T16:45:35.276Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 201.381135] nixbot[2639]: {"ts": "2026-08-16T16:45:35.289Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 201.384787] nixbot[2639]: {"ts": "2026-08-16T16:45:35.293Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 201.393128] nixbot[2639]: {"ts": "2026-08-16T16:45:35.301Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 201.406697] nixbot[2639]: {"ts": "2026-08-16T16:45:35.315Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 201.417366] nixbot[2639]: {"ts": "2026-08-16T16:45:35.326Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 201.425679] nixbot[2639]: {"ts": "2026-08-16T16:45:35.334Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 201.436500] nixbot[2639]: {"ts": "2026-08-16T16:45:35.345Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 201.445138] nixbot[2639]: {"ts": "2026-08-16T16:45:35.353Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 201.452796] nixbot[2639]: {"ts": "2026-08-16T16:45:35.361Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 201.460536] nixbot[2639]: {"ts": "2026-08-16T16:45:35.369Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 201.473257] nixbot[2639]: {"ts": "2026-08-16T16:45:35.381Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 201.481583] nixbot[2639]: {"ts": "2026-08-16T16:45:35.390Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 201.489314] nixbot[2639]: {"ts": "2026-08-16T16:45:35.398Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 201.501908] nixbot[2639]: {"ts": "2026-08-16T16:45:35.410Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 201.510169] nixbot[2639]: {"ts": "2026-08-16T16:45:35.418Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 201.518632] nixbot[2639]: {"ts": "2026-08-16T16:45:35.427Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 201.526348] nixbot[2639]: {"ts": "2026-08-16T16:45:35.435Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 201.893337] nixbot[2639]: INFO: Started server process [2639] gitlab # [ 201.895440] nixbot[2639]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 201.928960] nixbot[2639]: INFO: ::ffff:127.0.0.1:52076 - "GET /health HTTP/1.1" 200 OK gitlab # [ 201.934343] systemd[1]: Started nixbot CI service. gitlab # [ 201.935572] systemd[1]: Reached target Multi-User System. gitlab # [ 201.936340] systemd[1]: Startup finished in 1.328s (kernel) + 3.674s (initrd) + 3min 16.932s (userspace) = 3min 21.935s. gitlab # [ 202.604867] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:36 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 673 gitlab # [ 202.611607] nixbot[2639]: {"ts": "2026-08-16T16:45:36.520Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 202.642946] nixbot[2639]: {"ts": "2026-08-16T16:45:36.551Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 202.715907] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 59 gitlab # [ 202.721399] nixbot[2639]: {"ts": "2026-08-16T16:45:36.630Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 202.728160] nixbot[2639]: {"ts": "2026-08-16T16:45:36.637Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab: (finished: waiting for unit nixbot.service, in 2.08 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 202.963473] nixbot[2639]: INFO: ::ffff:127.0.0.1:52090 - "GET /health HTTP/1.1" 200 OK gitlab # [ 202.966241] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 231 gitlab # [ 202.973302] nixbot[2639]: {"ts": "2026-08-16T16:45:36.882Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 203.044781] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 46 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds) (finished: subtest: project discovered and webhook registered, in 0.07 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 203.115745] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 34 gitlab # [ 203.161601] nixbot[2639]: {"ts": "2026-08-16T16:45:37.069Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 203.162330] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 172 gitlab # [ 203.218355] gitaly[923]: time="2026-08-16T16:45:37.126Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSW35JHXPS3VHHXG3JV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.118" grpc.time_ms=7.93 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 203.228796] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 200 "" "git/2.55.0" 101 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 203.241642] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 66 gitlab # [ 203.245060] nixbot[2639]: {"ts": "2026-08-16T16:45:37.152Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 203.381569] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 134 gitlab # [ 203.382763] nixbot[2639]: {"ts": "2026-08-16T16:45:37.291Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 203.436742] gitaly[923]: time="2026-08-16T16:45:37.345Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDT4F72FAFJCJ130TVSH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-16T16:46:07.132" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:45:37.334" grpc.time_ms=10.04 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 203.448935] gitaly[923]: time="2026-08-16T16:45:37.357Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T16:46:07.041" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T16:45:37.341" grpc.time_ms=16.014 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 203.461382] gitaly[923]: time="2026-08-16T16:45:37.370Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDT4F72FAFJCJ130TVSH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:46:07.169" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:45:37.369" grpc.time_ms=0.569 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 203.473110] gitaly[923]: time="2026-08-16T16:45:37.382Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05QDSZY2VY4312PF871SY5F duration_ms=113ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 203.482061] gitaly[923]: time="2026-08-16T16:45:37.389Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=11 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDT4F72FAFJCJ130TVSH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-16T16:45:47.132" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:45:37.372" grpc.time_ms=16.473 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 203.500319] gitaly[923]: time="2026-08-16T16:45:37.409Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05QDSZY2VY4312PF871SY5F duration_ms=24ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 203.500912] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 114 gitlab # [ 203.502490] nixbot[2639]: {"ts": "2026-08-16T16:45:37.411Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 203.506791] gitaly[923]: time="2026-08-16T16:45:37.415Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:37.268" grpc.time_ms=147.675 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 203.536864] gitaly[923]: time="2026-08-16T16:45:37.445Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:37.444" grpc.time_ms=0.776 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 203.560577] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 53 gitlab # [ 203.561216] nixbot[2639]: {"ts": "2026-08-16T16:45:37.469Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 203.565132] nixbot[2639]: {"ts": "2026-08-16T16:45:37.474Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 203.579291] gitaly[923]: time="2026-08-16T16:45:37.488Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:37.487" grpc.time_ms=0.443 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 203.607979] gitaly[923]: time="2026-08-16T16:45:37.516Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:37.516" grpc.time_ms=0.339 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 203.650237] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 49 gitlab # [ 203.650842] gitaly[923]: time="2026-08-16T16:45:37.558Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDTB4SX8E9ZXQ4NE6D1S8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.550" grpc.time_ms=7.146 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 203.672077] gitaly[923]: time="2026-08-16T16:45:37.581Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05QDSZY2VY4312PF871SY5F duration_ms=34ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 203.675057] gitaly[923]: time="2026-08-16T16:45:37.583Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:37.546" grpc.time_ms=37.332 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 203.694019] gitaly[923]: time="2026-08-16T16:45:37.603Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F diskcache=64710adf-564d-44f6-9bd7-a08816e2e63f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.212" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 203.702494] gitaly[923]: time="2026-08-16T16:45:37.611Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=129 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13622 command.oublock=32 command.real_time_ms=379 command.spawn_token_fork_ms=0 command.system_time_ms=87 command.user_time_ms=42 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.212" grpc.time_ms=390.835 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 203.713950] gitlab-workhorse[828]: time="2026-08-16T16:45:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 203.714547] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 471 gitlab # To http://gitlab/root/test-flake.git gitlab # f48ee74..cd17408 master -> master gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.68 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 203.743111] gitaly[923]: time="2026-08-16T16:45:37.652Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTD4FBC1W8SMNMXNKARM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.643" pid=923 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 203.751702] gitaly[923]: time="2026-08-16T16:45:37.652Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTD4FBC1W8SMNMXNKARM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.643" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 203.762365] gitlab-workhorse[828]: time="2026-08-16T16:45:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 203.764059] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 80 gitlab # [ 203.765737] gitaly[923]: time="2026-08-16T16:45:37.652Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTD4FBC1W8SMNMXNKARM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.643" grpc.time_ms=8.366 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 203.807614] nixbot[2639]: INFO: ::ffff:127.0.0.1:48900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.07 seconds) gitlab # [ 203.836713] gitaly[923]: time="2026-08-16T16:45:37.745Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTFS91B5M0RB3RQZD36N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.733" pid=923 remote_ip="2001:db8:1::1" request_sha=f9e44253207f7139f217d2d78ef5c39329dd4e8b response_bytes=418 span.kind=server system=grpc gitlab # [ 203.845397] gitaly[923]: time="2026-08-16T16:45:37.745Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTFS91B5M0RB3RQZD36N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.733" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 203.856560] gitlab-workhorse[828]: time="2026-08-16T16:45:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=418 gitlab # [ 203.857143] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 89 gitlab # [ 203.857744] gitaly[923]: time="2026-08-16T16:45:37.746Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTFS91B5M0RB3RQZD36N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.733" grpc.time_ms=12.668 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 203.938264] gitaly[923]: time="2026-08-16T16:45:37.847Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDTMBBKYXX4WPCPDVAKJC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.838" grpc.time_ms=9 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 203.939070] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 44 gitlab # [ 203.988062] gitaly[923]: time="2026-08-16T16:45:37.897Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTNTYAYKSV5V4VTZ8QMN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.885" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 203.988768] gitaly[923]: time="2026-08-16T16:45:37.897Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTNTYAYKSV5V4VTZ8QMN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.885" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 204.006279] gitaly[923]: time="2026-08-16T16:45:37.915Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTNTYAYKSV5V4VTZ8QMN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.885" grpc.time_ms=11.56 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 204.006973] gitlab-workhorse[828]: time="2026-08-16T16:45:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 204.007794] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 65 gitlab # [ 204.102866] gitaly[923]: time="2026-08-16T16:45:38.011Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QDTS9AY3G1QJY73G9DYR3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:37.998" grpc.time_ms=12.945 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 204.122358] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 69 gitlab # [ 204.185787] gitaly[923]: time="2026-08-16T16:45:38.094Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTVKAJX61SRKG71T8930 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:38.075" pid=923 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 204.186588] gitaly[923]: time="2026-08-16T16:45:38.094Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTVKAJX61SRKG71T8930 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:38.075" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 204.187527] gitaly[923]: time="2026-08-16T16:45:38.095Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTVKAJX61SRKG71T8930 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:38.075" grpc.time_ms=19.449 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 204.188522] gitlab-workhorse[828]: time="2026-08-16T16:45:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 204.189509] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 61 gitlab # [ 204.318196] gitaly[923]: time="2026-08-16T16:45:38.226Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:46:08.025" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:45:38.225" grpc.time_ms=0.784 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.379626] gitaly[923]: time="2026-08-16T16:45:38.288Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T16:46:08.079" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:45:38.279" grpc.time_ms=9.064 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.421218] gitaly[923]: time="2026-08-16T16:45:38.330Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:45:48.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:45:38.323" grpc.time_ms=6.369 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.466875] gitaly[923]: time="2026-08-16T16:45:38.375Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:45:48.045" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:45:38.366" grpc.time_ms=9.091 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.546976] gitaly[923]: time="2026-08-16T16:45:38.455Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T16:45:48.134" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:38.454" grpc.time_ms=0.647 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.592621] gitaly[923]: time="2026-08-16T16:45:38.501Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T16:45:48.168" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:45:38.489" grpc.time_ms=11.266 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.654829] gitaly[923]: time="2026-08-16T16:45:38.563Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:38.562" grpc.time_ms=0.735 pid=923 span.kind=server system=grpc gitlab # [ 204.708161] gitaly[923]: time="2026-08-16T16:45:38.616Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:45:38.614" grpc.time_ms=1.793 pid=923 span.kind=server system=grpc gitlab # [ 204.730372] gitaly[923]: time="2026-08-16T16:45:38.639Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 diskcache=96b2ab10-626c-4087-b2a6-dd08806fea01 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:45:48.183" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:38.504" pid=923 ref=refs/keep-around/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e remote_ip="2001:db8:1::1" revision=f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e span.kind=server system=grpc username=root gitlab # [ 204.731655] gitaly[923]: time="2026-08-16T16:45:38.639Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=91 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5364 command.oublock=8 command.real_time_ms=125 command.spawn_token_fork_ms=2 command.system_time_ms=60 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:45:48.183" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:45:38.504" grpc.time_ms=134.748 pid=923 ref=refs/keep-around/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e remote_ip="2001:db8:1::1" revision=f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e span.kind=server system=grpc username=root gitlab # [ 204.756594] gitaly[923]: time="2026-08-16T16:45:38.665Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:46:08.364" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:45:38.664" grpc.time_ms=0.56 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 204.837476] nixbot[2639]: INFO: ::ffff:127.0.0.1:48906 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.03 seconds) gitlab # [ 204.886437] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 619 gitlab # [ 204.892100] nixbot[2639]: {"ts": "2026-08-16T16:45:38.795Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e \"HTTP/1.1 201 Created\""} gitlab # [ 204.899607] nixbot[2639]: {"ts": "2026-08-16T16:45:38.808Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-f48ee74eaf0e-0"} gitlab # [ 204.960690] systemd[1]: Started Nix Daemon. gitlab # [ 205.031330] nix-daemon[2847]: accepted connection from pid 2841, user nixbot gitlab # [ 205.107683] nix-daemon[2847]: accepted connection from pid 2854, user nixbot gitlab # [ 205.128693] nixbot[2639]: {"ts": "2026-08-16T16:45:39.037Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-f48ee74eaf0e-0", "argv0": "bwrap"} gitlab # [ 205.250626] nix-daemon[2847]: accepted connection from pid 2864, user nixbot gitlab # [ 205.297778] nix-daemon[2847]: accepted connection from pid 2874, user nixbot gitlab # [ 205.317372] nix-daemon[2847]: accepted connection from pid 2864, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 205.878959] nixbot[2639]: INFO: ::ffff:127.0.0.1:48908 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 206.913561] nixbot[2639]: INFO: ::ffff:127.0.0.1:48920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 207.949348] nixbot[2639]: INFO: ::ffff:127.0.0.1:48926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 208.988584] nixbot[2639]: INFO: ::ffff:127.0.0.1:48936 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 210.025940] nixbot[2639]: INFO: ::ffff:127.0.0.1:48938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 210.302288] nix-daemon[2847]: accepted connection from pid 2906, user nixbot gitlab # [ 210.345563] gitaly[923]: time="2026-08-16T16:45:44.253Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QE0W32GTEC10E769K55WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:46:14.051" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:45:44.252" grpc.time_ms=0.94 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 210.420976] gitaly[923]: time="2026-08-16T16:45:44.329Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QE0W32GTEC10E769K55WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:45:54.082" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:45:44.322" grpc.time_ms=6.826 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 210.514881] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 226 gitlab # [ 210.520257] nixbot[2639]: {"ts": "2026-08-16T16:45:44.427Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e \"HTTP/1.1 201 Created\""} gitlab # [ 210.559931] gitaly[923]: time="2026-08-16T16:45:44.468Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QE13GQS6G7018Q4BP3Z7R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:46:14.266" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:45:44.467" grpc.time_ms=0.919 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 210.598453] gitaly[923]: time="2026-08-16T16:45:44.507Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QE13GQS6G7018Q4BP3Z7R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:45:54.258" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:45:44.499" grpc.time_ms=7.911 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 210.666369] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 142 gitlab # [ 210.672147] nixbot[2639]: {"ts": "2026-08-16T16:45:44.575Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 211.067815] nixbot[2639]: INFO: ::ffff:127.0.0.1:48940 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 212.109448] nixbot[2639]: INFO: ::ffff:127.0.0.1:48952 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 213.150320] nixbot[2639]: INFO: ::ffff:127.0.0.1:35906 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 214.191331] nixbot[2639]: INFO: ::ffff:127.0.0.1:35920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 214.721340] nix-daemon[2847]: accepted connection from pid 2948, user nixbot gitlab # [ 214.820099] gitaly[923]: time="2026-08-16T16:45:48.728Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QE57YMKPE15QCC9KS2AN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:46:18.426" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:45:48.726" grpc.time_ms=0.926 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 214.868652] gitaly[923]: time="2026-08-16T16:45:48.777Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QE57YMKPE15QCC9KS2AN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:45:58.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:45:48.766" grpc.time_ms=10.787 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 214.946834] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 184 gitlab # [ 214.948316] nixbot[2639]: {"ts": "2026-08-16T16:45:48.856Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e \"HTTP/1.1 201 Created\""} gitlab # [ 215.038668] nix-daemon[2847]: accepted connection from pid 2962, user nixbot gitlab # [ 215.130972] gitaly[923]: time="2026-08-16T16:45:49.039Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QE5J2H32B3WDFGP555K7A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:49.029" grpc.time_ms=10.059 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 215.157763] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 71 gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 215.211586] gitaly[923]: time="2026-08-16T16:45:49.120Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QE5MEQB6BFFSCH6BE1NRE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:49.107" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 215.216273] gitaly[923]: time="2026-08-16T16:45:49.122Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05QE5MEQB6BFFSCH6BE1NRE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:49.107" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 215.218265] gitlab-workhorse[828]: time="2026-08-16T16:45:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 215.219230] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:45:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 53 gitlab # [ 215.220359] gitaly[923]: time="2026-08-16T16:45:49.123Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05QE5MEQB6BFFSCH6BE1NRE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:45:49.107" grpc.time_ms=15.582 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 215.222847] nixbot[2639]: INFO: ::ffff:127.0.0.1:35928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.07 seconds) gitlab # [ 215.342998] nix-daemon[2847]: accepted connection from pid 2990, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 216.300992] nixbot[2639]: INFO: ::ffff:127.0.0.1:35940 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 217.340161] nixbot[2639]: INFO: ::ffff:127.0.0.1:35944 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 218.378335] nixbot[2639]: INFO: ::ffff:127.0.0.1:35952 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 219.415414] nixbot[2639]: INFO: ::ffff:127.0.0.1:35964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 220.451926] nixbot[2639]: INFO: ::ffff:127.0.0.1:35976 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 221.488775] nixbot[2639]: INFO: ::ffff:127.0.0.1:35990 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 222.525563] nixbot[2639]: INFO: ::ffff:127.0.0.1:35992 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 223.562460] nixbot[2639]: INFO: ::ffff:127.0.0.1:54582 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 224.597055] nixbot[2639]: INFO: ::ffff:127.0.0.1:54590 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 225.633920] nixbot[2639]: INFO: ::ffff:127.0.0.1:54602 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 226.169055] sidekiq-cluster[2534]: 2026-08-16T16:46:00.077Z pid=2534 tid=xu6 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2534, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432693248} gitlab # [ 226.400602] sidekiq-cluster[2534]: W, [2026-08-16T16:46:00.309414 #2534] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 226.442171] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:00.350Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 226.671378] nixbot[2639]: INFO: ::ffff:127.0.0.1:54614 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 227.710393] nixbot[2639]: INFO: ::ffff:127.0.0.1:54618 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 228.380758] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:02.288Z","message":"GitLab reliable fetch activated!"} gitlab # [ 228.382603] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:02.289Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 228.748560] nixbot[2639]: INFO: ::ffff:127.0.0.1:54634 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 229.786769] nixbot[2639]: INFO: ::ffff:127.0.0.1:54646 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 230.825651] nixbot[2639]: INFO: ::ffff:127.0.0.1:54654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 231.862304] nixbot[2639]: INFO: ::ffff:127.0.0.1:54664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 232.898657] nixbot[2639]: INFO: ::ffff:127.0.0.1:54680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 233.936265] nixbot[2639]: INFO: ::ffff:127.0.0.1:46234 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 234.972448] nixbot[2639]: INFO: ::ffff:127.0.0.1:46236 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 236.009147] nixbot[2639]: INFO: ::ffff:127.0.0.1:46250 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 237.045895] nixbot[2639]: INFO: ::ffff:127.0.0.1:46254 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 238.084070] nixbot[2639]: INFO: ::ffff:127.0.0.1:46256 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 239.121669] nixbot[2639]: INFO: ::ffff:127.0.0.1:46264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 240.158261] nixbot[2639]: INFO: ::ffff:127.0.0.1:46274 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 241.196903] nixbot[2639]: INFO: ::ffff:127.0.0.1:46278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 242.234228] nixbot[2639]: INFO: ::ffff:127.0.0.1:46294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 243.272506] nixbot[2639]: INFO: ::ffff:127.0.0.1:56820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.03 seconds) gitlab # [ 244.310616] nixbot[2639]: INFO: ::ffff:127.0.0.1:56832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 245.345818] nixbot[2639]: INFO: ::ffff:127.0.0.1:56834 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 246.383646] nixbot[2639]: INFO: ::ffff:127.0.0.1:56838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 247.413430] nixbot[2639]: INFO: ::ffff:127.0.0.1:56848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 248.450598] nixbot[2639]: INFO: ::ffff:127.0.0.1:56854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 249.487263] nixbot[2639]: INFO: ::ffff:127.0.0.1:56868 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 249.783968] postgres[3109]: [3109] ERROR: relation "table_without_models" does not exist gitlab # [ 249.785412] postgres[3109]: [3109] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 250.524209] nixbot[2639]: INFO: ::ffff:127.0.0.1:56878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 251.562095] nixbot[2639]: INFO: ::ffff:127.0.0.1:56890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 252.231127] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:26.139Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 252.233775] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:26.142Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 252.234622] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:26.142Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 252.235605] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:26.142Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 252.236988] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:26.145Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 252.600387] nixbot[2639]: INFO: ::ffff:127.0.0.1:56894 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 253.641439] nixbot[2639]: INFO: ::ffff:127.0.0.1:49888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 253.836518] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:27.744Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"fc095d90d86d06bbb64c00e3","created_at":"2026-08-16T16:45:31.549Z","trace_propagation_headers":{"sentry-trace":"1c35c94f454844c8bb8ecfbc99420064-026748e8cff846c9","baggage":"sentry-trace_id=1c35c94f454844c8bb8ecfbc99420064,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDJ9M0CNXFXAQTF6ARGVZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:31.573Z","job_size_bytes":2,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-fc095d90d86d06bbb64c00e3: start","job_status":"start","queue_duration_s":56.170637,"scheduling_latency_s":56.170738} gitlab # [ 254.043523] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:27.951Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"fc095d90d86d06bbb64c00e3","created_at":"2026-08-16T16:45:31.549Z","trace_propagation_headers":{"sentry-trace":"1c35c94f454844c8bb8ecfbc99420064-026748e8cff846c9","baggage":"sentry-trace_id=1c35c94f454844c8bb8ecfbc99420064,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDJ9M0CNXFXAQTF6ARGVZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:31.573Z","job_size_bytes":2,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-fc095d90d86d06bbb64c00e3: done: 0.208017 sec","job_status":"done","queue_duration_s":56.170637,"scheduling_latency_s":56.170738,"redis_calls":25,"redis_duration_s":0.007064999999999999,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003957,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00178,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.095015986,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.208017,"completed_at":"2026-08-16T16:46:27.951Z","load_balancing_strategy":"primary","db_duration_s":0.064709,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 254.096704] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:28.005Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"142c3262143ed25f92168976","created_at":"2026-08-16T16:45:31.581Z","trace_propagation_headers":{"sentry-trace":"1c35c94f454844c8bb8ecfbc99420064-026748e8cff846c9","baggage":"sentry-trace_id=1c35c94f454844c8bb8ecfbc99420064,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDJ9M0CNXFXAQTF6ARGVZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:31.584Z","job_size_bytes":2,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-142c3262143ed25f92168976: start","job_status":"start","queue_duration_s":56.420569,"scheduling_latency_s":56.420602} gitlab # [ 254.224607] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:28.133Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"142c3262143ed25f92168976","created_at":"2026-08-16T16:45:31.581Z","trace_propagation_headers":{"sentry-trace":"1c35c94f454844c8bb8ecfbc99420064-026748e8cff846c9","baggage":"sentry-trace_id=1c35c94f454844c8bb8ecfbc99420064,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDJ9M0CNXFXAQTF6ARGVZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:31.584Z","job_size_bytes":2,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-142c3262143ed25f92168976: done: 0.127918 sec","job_status":"done","queue_duration_s":56.420569,"scheduling_latency_s":56.420602,"redis_calls":14,"redis_duration_s":0.003525,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000723,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001484,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001318,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09365994799999999,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.127918,"completed_at":"2026-08-16T16:46:28.133Z","load_balancing_strategy":"primary","db_duration_s":0.026536,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 254.297805] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:28.206Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"012b6daa8787919ae6e7c943","created_at":"2026-08-16T16:45:32.359Z","trace_propagation_headers":{"sentry-trace":"1c35c94f454844c8bb8ecfbc99420064-026748e8cff846c9","baggage":"sentry-trace_id=1c35c94f454844c8bb8ecfbc99420064,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDJ9M0CNXFXAQTF6ARGVZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:32.364Z","job_size_bytes":5,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-012b6daa8787919ae6e7c943: start","job_status":"start","queue_duration_s":55.841866,"scheduling_latency_s":55.841898} gitlab # [ 254.463485] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:28.372Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"012b6daa8787919ae6e7c943","created_at":"2026-08-16T16:45:32.359Z","trace_propagation_headers":{"sentry-trace":"1c35c94f454844c8bb8ecfbc99420064-026748e8cff846c9","baggage":"sentry-trace_id=1c35c94f454844c8bb8ecfbc99420064,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDJ9M0CNXFXAQTF6ARGVZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:32.364Z","job_size_bytes":5,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-012b6daa8787919ae6e7c943: done: 0.166078 sec","job_status":"done","queue_duration_s":55.841866,"scheduling_latency_s":55.841898,"redis_calls":12,"redis_duration_s":0.003124,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000715,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001881,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000528,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000328534,"duration_s":0.166078,"completed_at":"2026-08-16T16:46:28.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027752,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 254.538914] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:28.447Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"12b259119b7f25c17d11d90f","created_at":"2026-08-16T16:45:32.385Z","trace_propagation_headers":{"sentry-trace":"1c35c94f454844c8bb8ecfbc99420064-026748e8cff846c9","baggage":"sentry-trace_id=1c35c94f454844c8bb8ecfbc99420064,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDJ9M0CNXFXAQTF6ARGVZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:32.388Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-12b259119b7f25c17d11d90f: start","job_status":"start","queue_duration_s":56.059061,"scheduling_latency_s":56.059093} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 254.685440] nixbot[2639]: INFO: ::ffff:127.0.0.1:49890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.05 seconds) gitlab # [ 254.755783] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:28.664Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"12b259119b7f25c17d11d90f","created_at":"2026-08-16T16:45:32.385Z","trace_propagation_headers":{"sentry-trace":"1c35c94f454844c8bb8ecfbc99420064-026748e8cff846c9","baggage":"sentry-trace_id=1c35c94f454844c8bb8ecfbc99420064,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDJ9M0CNXFXAQTF6ARGVZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:32.388Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-12b259119b7f25c17d11d90f: done: 0.217036 sec","job_status":"done","queue_duration_s":56.059061,"scheduling_latency_s":56.059093,"redis_calls":11,"redis_duration_s":0.003039,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000711,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001968,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.163,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.163,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000296406,"duration_s":0.217036,"completed_at":"2026-08-16T16:46:28.664Z","load_balancing_strategy":"primary","db_duration_s":0.075691,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.797805] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:28.706Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"d57c38b44742748ecb930ec4","created_at":"2026-08-16T16:45:32.390Z","trace_propagation_headers":{"sentry-trace":"1c35c94f454844c8bb8ecfbc99420064-026748e8cff846c9","baggage":"sentry-trace_id=1c35c94f454844c8bb8ecfbc99420064,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDJ9M0CNXFXAQTF6ARGVZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:32.393Z","job_size_bytes":89,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-d57c38b44742748ecb930ec4: start","job_status":"start","queue_duration_s":56.312395,"scheduling_latency_s":56.312497} gitlab # [ 254.863701] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:28.771Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"d57c38b44742748ecb930ec4","created_at":"2026-08-16T16:45:32.390Z","trace_propagation_headers":{"sentry-trace":"1c35c94f454844c8bb8ecfbc99420064-026748e8cff846c9","baggage":"sentry-trace_id=1c35c94f454844c8bb8ecfbc99420064,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDJ9M0CNXFXAQTF6ARGVZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:32.393Z","job_size_bytes":89,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-d57c38b44742748ecb930ec4: done: 0.06526 sec","job_status":"done","queue_duration_s":56.312395,"scheduling_latency_s":56.312497,"redis_calls":11,"redis_duration_s":0.0027930000000000003,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000671,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001564,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000625498,"duration_s":0.06526,"completed_at":"2026-08-16T16:46:28.771Z","load_balancing_strategy":"primary","db_duration_s":0.007025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.921810] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:28.830Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8be742e81fb90634181b5069","created_at":"2026-08-16T16:45:33.721Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-c2d897eb8e4d46f7","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:33.743Z","job_size_bytes":185,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8be742e81fb90634181b5069: start","job_status":"start","queue_duration_s":55.086634,"scheduling_latency_s":55.086732} gitlab # [ 254.947152] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:28.855Z","message":"changes: \"0000000000000000000000000000000000000000 f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e refs/heads/master\\n\""} gitlab # [ 255.001676] gitaly[923]: time="2026-08-16T16:46:28.909Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:38.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:28.898" grpc.time_ms=10.758 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.019326] gitaly[923]: time="2026-08-16T16:46:28.928Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:46:38.026" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:46:28.916" grpc.time_ms=11.035 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.105964] gitaly[923]: time="2026-08-16T16:46:29.014Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T16:46:39.004" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:29.004" grpc.time_ms=10.075 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.142505] gitaly[923]: time="2026-08-16T16:46:29.051Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:29.051" grpc.time_ms=0.272 pid=923 span.kind=server system=grpc gitlab # [ 255.198183] gitaly[923]: time="2026-08-16T16:46:29.106Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:29.106" grpc.time_ms=0.555 pid=923 span.kind=server system=grpc gitlab # [ 255.228369] gitaly[923]: time="2026-08-16T16:46:29.137Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW diskcache=057530b3-9c84-4991-831a-3280d77a49b9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:46:39.029" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:46:29.029" pid=923 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 255.230174] gitaly[923]: time="2026-08-16T16:46:29.137Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=69 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4907 command.oublock=8 command.real_time_ms=98 command.spawn_token_fork_ms=0 command.system_time_ms=44 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:46:39.029" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:46:29.029" grpc.time_ms=107.682 pid=923 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 255.252540] gitaly[923]: time="2026-08-16T16:46:29.161Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:46:39.160" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:46:29.160" grpc.time_ms=0.187 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.273566] gitaly[923]: time="2026-08-16T16:46:29.182Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=942 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T16:46:39.165" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:29.166" grpc.time_ms=15.872 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.365547] gitaly[923]: time="2026-08-16T16:46:29.274Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-16T16:46:59.065" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:29.266" grpc.time_ms=7.933 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.389136] gitaly[923]: time="2026-08-16T16:46:29.298Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T16:46:39.297" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:46:29.297" grpc.time_ms=0.326 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.422130] gitaly[923]: time="2026-08-16T16:46:29.331Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T16:46:39.003" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T16:46:29.323" grpc.time_ms=7.237 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.450509] gitaly[923]: time="2026-08-16T16:46:29.359Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:39.028" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:29.348" grpc.time_ms=10.774 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.471887] gitaly[923]: time="2026-08-16T16:46:29.380Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:39.050" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:29.370" grpc.time_ms=9.906 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.506513] gitaly[923]: time="2026-08-16T16:46:29.415Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T16:46:59.197" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:29.397" grpc.time_ms=17.62 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 255.732084] nixbot[2639]: INFO: ::ffff:127.0.0.1:49892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 255.910149] gitaly[923]: time="2026-08-16T16:46:29.819Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T16:46:39.007" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:29.817" grpc.time_ms=1.264 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.968147] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:29.876Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8be742e81fb90634181b5069","created_at":"2026-08-16T16:45:33.721Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-c2d897eb8e4d46f7","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:33.743Z","job_size_bytes":185,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8be742e81fb90634181b5069: done: 1.045991 sec","job_status":"done","queue_duration_s":55.086634,"scheduling_latency_s":55.086732,"gitaly_calls":13,"gitaly_duration_s":0.329427,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.078975,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.00466,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.007681,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001889,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003593,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.02448,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.036672,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.187,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.208,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.058,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.566284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000881677,"exclusive_lock_hold_duration_s":0.038921148,"duration_s":1.045991,"completed_at":"2026-08-16T16:46:29.875Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.102964,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.981525] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:29.877Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e cd17408d6c89a30d2788fd8b48218458c0bbf791 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a7af0d15bf79ee37b1e5af72","created_at":"2026-08-16T16:45:37.567Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-f4245ecf376744ea","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:37.569Z","job_size_bytes":185,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a7af0d15bf79ee37b1e5af72: start","job_status":"start","queue_duration_s":52.308323,"scheduling_latency_s":52.308339} gitlab # [ 256.061607] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:29.970Z","message":"changes: \"f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e cd17408d6c89a30d2788fd8b48218458c0bbf791 refs/heads/master\\n\""} gitlab # [ 256.095376] gitaly[923]: time="2026-08-16T16:46:30.003Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:39.102" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:29.992" grpc.time_ms=11.04 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.115785] gitaly[923]: time="2026-08-16T16:46:30.024Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:46:40.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:46:30.015" grpc.time_ms=9.142 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.119489] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:30.028Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"3bb65cd60536ccea5b48f215","created_at":"2026-08-16T16:46:30.026Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-947fd9222cc04f9e","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"8ae29d50d3ff2c55cc14251f","job_size_bytes":46,"pid":2534,"job_status":"deduplicated","message":"ProjectCacheWorker JID-3bb65cd60536ccea5b48f215: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 256.137723] gitaly[923]: time="2026-08-16T16:46:30.046Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T16:46:40.037" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:30.037" grpc.time_ms=9.095 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.161897] gitaly[923]: time="2026-08-16T16:46:30.070Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-16T16:47:00.061" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:30.061" grpc.time_ms=8.751 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.188881] gitaly[923]: time="2026-08-16T16:46:30.097Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T16:46:40.090" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T16:46:30.091" grpc.time_ms=6.548 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.221643] gitaly[923]: time="2026-08-16T16:46:30.130Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:40.121" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:30.122" grpc.time_ms=8.435 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.305982] gitaly[923]: time="2026-08-16T16:46:30.214Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T16:46:40.212" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:30.212" grpc.time_ms=1.874 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.326920] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:30.235Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e cd17408d6c89a30d2788fd8b48218458c0bbf791 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a7af0d15bf79ee37b1e5af72","created_at":"2026-08-16T16:45:37.567Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-f4245ecf376744ea","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:45:37.569Z","job_size_bytes":185,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a7af0d15bf79ee37b1e5af72: done: 0.358069 sec","job_status":"done","queue_duration_s":52.308323,"scheduling_latency_s":52.308339,"gitaly_calls":7,"gitaly_duration_s":0.113437,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.023376,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.002438,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000961,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003382,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.008007,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.008588,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.019,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.019,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.136572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000865194,"exclusive_lock_hold_duration_s":0.021538212,"duration_s":0.358069,"completed_at":"2026-08-16T16:46:30.235Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028377,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 256.376747] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:30.236Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"599e6235ef81e05b57de1d53","created_at":"2026-08-16T16:45:38.671Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-5614f0b4f39140ce","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:38.678Z","job_size_bytes":65,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-599e6235ef81e05b57de1d53: start","job_status":"start","queue_duration_s":51.55878,"scheduling_latency_s":51.558798} gitlab # [ 256.467326] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:30.375Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"599e6235ef81e05b57de1d53","created_at":"2026-08-16T16:45:38.671Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-5614f0b4f39140ce","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:38.678Z","job_size_bytes":65,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-599e6235ef81e05b57de1d53: done: 0.138597 sec","job_status":"done","queue_duration_s":51.55878,"scheduling_latency_s":51.558798,"redis_calls":16,"redis_duration_s":0.004325,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00228,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001567,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000525206,"duration_s":0.138597,"completed_at":"2026-08-16T16:46:30.375Z","load_balancing_strategy":"primary","db_duration_s":0.016385,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 256.530440] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:30.438Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"545e86c6fca86e136bb3137b","created_at":"2026-08-16T16:45:38.678Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-5614f0b4f39140ce","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:38.681Z","job_size_bytes":65,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-545e86c6fca86e136bb3137b: start","job_status":"start","queue_duration_s":51.756799,"scheduling_latency_s":51.756846} gitlab # [ 256.660120] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:30.568Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"545e86c6fca86e136bb3137b","created_at":"2026-08-16T16:45:38.678Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-5614f0b4f39140ce","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:38.681Z","job_size_bytes":65,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-545e86c6fca86e136bb3137b: done: 0.129568 sec","job_status":"done","queue_duration_s":51.756799,"scheduling_latency_s":51.756846,"redis_calls":21,"redis_duration_s":0.007295,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002978,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002233,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000516546,"duration_s":0.129568,"completed_at":"2026-08-16T16:46:30.568Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 256.663600] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:30.570Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"480a0de768b12e63c19b3865","created_at":"2026-08-16T16:45:38.778Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-5614f0b4f39140ce","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:38.781Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-480a0de768b12e63c19b3865: start","job_status":"start","queue_duration_s":51.788807,"scheduling_latency_s":51.788856} gitlab # [ 256.770779] nixbot[2639]: INFO: ::ffff:127.0.0.1:49898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 256.857992] gitaly[923]: time="2026-08-16T16:46:30.766Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:30.766" grpc.time_ms=0.773 pid=923 span.kind=server system=grpc gitlab # [ 256.921717] gitaly[923]: time="2026-08-16T16:46:30.830Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:30.829" grpc.time_ms=0.624 pid=923 span.kind=server system=grpc gitlab # [ 256.978575] gitaly[923]: time="2026-08-16T16:46:30.887Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:30.886" grpc.time_ms=0.666 pid=923 span.kind=server system=grpc gitlab # [ 257.009936] gitaly[923]: time="2026-08-16T16:46:30.918Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 diskcache=930624de-481d-446b-ac9d-77ef290549a3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:47:00.727" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:30.727" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.011310] gitaly[923]: time="2026-08-16T16:46:30.919Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=181 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7631 command.oublock=0 command.real_time_ms=180 command.spawn_token_fork_ms=0 command.system_time_ms=123 command.user_time_ms=58 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:47:00.727" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:30.727" grpc.time_ms=191.101 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.158909] gitaly[923]: time="2026-08-16T16:46:31.067Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:47:01.065" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:31.065" grpc.time_ms=1.382 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.194455] gitaly[923]: time="2026-08-16T16:46:31.103Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:01.101" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:31.102" grpc.time_ms=0.653 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.212971] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:31.120Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"480a0de768b12e63c19b3865","created_at":"2026-08-16T16:45:38.778Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-5614f0b4f39140ce","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:38.781Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2534,"job_status":"rescheduled","message":"PipelineProcessWorker JID-480a0de768b12e63c19b3865: rescheduled"} gitlab # [ 257.225731] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:31.134Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"480a0de768b12e63c19b3865","created_at":"2026-08-16T16:45:38.778Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-5614f0b4f39140ce","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:45:38.781Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-480a0de768b12e63c19b3865: done: 0.563516 sec","job_status":"done","queue_duration_s":51.788807,"scheduling_latency_s":51.788856,"gitaly_calls":3,"gitaly_duration_s":0.227069,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.031448000000000004,"redis_read_bytes":462,"redis_write_bytes":29293,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001772,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001219,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.011105,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004451,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15580,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007606,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000619,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000485,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002419,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.022,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.025,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.246117,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.483452506,"duration_s":0.563516,"completed_at":"2026-08-16T16:46:31.134Z","load_balancing_strategy":"primary","db_duration_s":0.070988,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.248566] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:31.136Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8ae29d50d3ff2c55cc14251f","created_at":"2026-08-16T16:46:28.953Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-b3f18a423c0b42a5","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:28.976Z","job_size_bytes":46,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8ae29d50d3ff2c55cc14251f: start","job_status":"start","queue_duration_s":2.160011,"scheduling_latency_s":2.160044} gitlab # [ 257.280744] gitaly[923]: time="2026-08-16T16:46:31.189Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T22:46:31.183" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:46:31.184" grpc.time_ms=4.974 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.299189] gitaly[923]: time="2026-08-16T16:46:31.208Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T16:47:01.201" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:31.201" grpc.time_ms=6.341 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.332714] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:31.241Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8ae29d50d3ff2c55cc14251f","created_at":"2026-08-16T16:46:28.953Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-b3f18a423c0b42a5","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:28.976Z","job_size_bytes":46,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8ae29d50d3ff2c55cc14251f: done: 0.104748 sec","job_status":"done","queue_duration_s":2.160011,"scheduling_latency_s":2.160044,"gitaly_calls":2,"gitaly_duration_s":0.016466,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007747,"redis_read_bytes":69,"redis_write_bytes":4885,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001402,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000538,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2113,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001814,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003001,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000540851,"duration_s":0.104748,"completed_at":"2026-08-16T16:46:31.241Z","load_balancing_strategy":"primary","db_duration_s":0.015717,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.336117] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:31.243Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"fb93628bbe1775f3056f0627","created_at":"2026-08-16T16:46:28.994Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-b3f18a423c0b42a5","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:28.999Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-fb93628bbe1775f3056f0627: start","job_status":"start","queue_duration_s":2.243797,"scheduling_latency_s":2.243823} gitlab # [ 257.383356] gitaly[923]: time="2026-08-16T16:46:31.292Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW diskcache=549085bf-f9db-499c-8c4f-b47e99af70c8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T22:46:31.262" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:31.263" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.384285] gitaly[923]: time="2026-08-16T16:46:31.292Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1290 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T22:46:31.262" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:31.263" grpc.time_ms=28.924 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.437869] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:31.346Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"fb93628bbe1775f3056f0627","created_at":"2026-08-16T16:46:28.994Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-b3f18a423c0b42a5","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:28.999Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-fb93628bbe1775f3056f0627: done: 0.103444 sec","job_status":"done","queue_duration_s":2.243797,"scheduling_latency_s":2.243823,"gitaly_calls":1,"gitaly_duration_s":0.052526,"redis_calls":15,"redis_duration_s":0.003798,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001508,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000651,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001196,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08340249899999999,"duration_s":0.103444,"completed_at":"2026-08-16T16:46:31.346Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017104,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.440453] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:31.347Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ed2b6729c37f70731cbec433","created_at":"2026-08-16T16:46:29.154Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-b3f18a423c0b42a5","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:29.157Z","job_size_bytes":23,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ed2b6729c37f70731cbec433: start","job_status":"start","queue_duration_s":2.190674,"scheduling_latency_s":2.19069} gitlab # [ 257.470390] gitaly[923]: time="2026-08-16T16:46:31.379Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T16:47:01.367" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:31.367" grpc.time_ms=11.205 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.507731] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:31.416Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ed2b6729c37f70731cbec433","created_at":"2026-08-16T16:46:29.154Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-b3f18a423c0b42a5","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:29.157Z","job_size_bytes":23,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ed2b6729c37f70731cbec433: done: 0.068446 sec","job_status":"done","queue_duration_s":2.190674,"scheduling_latency_s":2.19069,"gitaly_calls":1,"gitaly_duration_s":0.042548,"redis_calls":16,"redis_duration_s":0.003703,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000273,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001678,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000683,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.068446,"completed_at":"2026-08-16T16:46:31.416Z","load_balancing_strategy":"primary","db_duration_s":0.002975,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.509456] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:31.417Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"898e28cd719000d61f8c9b3e","created_at":"2026-08-16T16:46:29.674Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-b3f18a423c0b42a5","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2bac200c50cfd8c55d400751feaea8efde07ae474628df7bab4132d507057c7","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:29.681Z","job_size_bytes":467,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-898e28cd719000d61f8c9b3e: start","job_status":"start","queue_duration_s":1.735984,"scheduling_latency_s":1.736005} gitlab # [ 257.556296] gitaly[923]: time="2026-08-16T16:46:31.438Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:01.437" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:31.437" grpc.time_ms=0.764 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.582793] gitaly[923]: time="2026-08-16T16:46:31.491Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T16:46:41.159" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:31.480" grpc.time_ms=11.317 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.714665] gitaly[923]: time="2026-08-16T16:46:31.623Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:47:01.621" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:31.622" grpc.time_ms=1.318 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.720170] gitaly[923]: time="2026-08-16T16:46:31.629Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=32 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T16:47:01.625" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:31.626" grpc.time_ms=2.742 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 257.815359] nixbot[2639]: INFO: ::ffff:127.0.0.1:49906 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.05 seconds) gitlab # [ 257.823762] gitaly[923]: time="2026-08-16T16:46:31.732Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:41.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:31.717" grpc.time_ms=14.696 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.291178] gitaly[923]: time="2026-08-16T16:46:32.199Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T16:47:02.180" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.181" grpc.time_ms=18.295 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.306882] gitaly[923]: time="2026-08-16T16:46:32.215Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDNYDM379Q5R1CEFAA8SW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T16:47:02.202" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.202" grpc.time_ms=13.012 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.341892] sidekiq-cluster[2534]: {"severity":"WARN","time":"2026-08-16T16:46:32.250Z","class":"CreatePipelineWorker","correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e","ref":"refs/heads/master"},"retry":0} gitlab # [ 258.350458] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:32.258Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"898e28cd719000d61f8c9b3e","created_at":"2026-08-16T16:46:29.674Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-b3f18a423c0b42a5","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2bac200c50cfd8c55d400751feaea8efde07ae474628df7bab4132d507057c7","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:29.681Z","job_size_bytes":467,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-898e28cd719000d61f8c9b3e: done: 0.841022 sec","job_status":"done","queue_duration_s":1.735984,"scheduling_latency_s":1.736005,"gitaly_calls":7,"gitaly_duration_s":0.128567,"redis_calls":51,"redis_duration_s":0.009881,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.000758,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004548,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002467,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.643739,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364571,"duration_s":0.841022,"completed_at":"2026-08-16T16:46:32.258Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055757,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 258.358166] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:32.260Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"85c73f6e-5eeb-478f-87c9-15c19175ed1f\"}"],"class":"WebHookWorker","jid":"b66aa54d3877a13e7585caa1","created_at":"2026-08-16T16:46:29.792Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-b3f18a423c0b42a5","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6907324cade1d254395f5311a517d2998ad4587a3ec337cf6b0a73b98891cd0b","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:29.797Z","job_size_bytes":1751,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b66aa54d3877a13e7585caa1: start","job_status":"start","queue_duration_s":2.463448,"scheduling_latency_s":2.463473} gitlab # [ 258.455930] nixbot[2639]: INFO: ::ffff:127.0.0.1:49920 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 258.479737] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:32.387Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"85c73f6e-5eeb-478f-87c9-15c19175ed1f\"}"],"class":"WebHookWorker","jid":"b66aa54d3877a13e7585caa1","created_at":"2026-08-16T16:46:29.792Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-b3f18a423c0b42a5","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6907324cade1d254395f5311a517d2998ad4587a3ec337cf6b0a73b98891cd0b","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:29.797Z","job_size_bytes":1751,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b66aa54d3877a13e7585caa1: done: 0.1268 sec","job_status":"done","queue_duration_s":2.463448,"scheduling_latency_s":2.463473,"redis_calls":19,"redis_duration_s":0.00437,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001008,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000489,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001874,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03086453700001357,"cpu_s":0.080455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051906,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.1268,"completed_at":"2026-08-16T16:46:32.387Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.509175] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:32.390Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"adf6474a90d0401cf3f4fc6e","created_at":"2026-08-16T16:46:30.032Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-947fd9222cc04f9e","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"fb93628bbe1775f3056f0627","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.034Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-adf6474a90d0401cf3f4fc6e: start","job_status":"start","queue_duration_s":2.355782,"scheduling_latency_s":2.355872} gitlab # [ 258.515207] gitaly[923]: time="2026-08-16T16:46:32.424Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F diskcache=1dea35c2-5f79-48cd-b0a4-a66fccff5122 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T22:46:32.412" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.413" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.515889] gitaly[923]: time="2026-08-16T16:46:32.424Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T22:46:32.412" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.413" grpc.time_ms=11.217 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.552816] gitaly[923]: time="2026-08-16T16:46:32.461Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:02.460" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.460" grpc.time_ms=0.44 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.553731] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:32.440Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"adf6474a90d0401cf3f4fc6e","created_at":"2026-08-16T16:46:30.032Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-947fd9222cc04f9e","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"fb93628bbe1775f3056f0627","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.034Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-adf6474a90d0401cf3f4fc6e: done: 0.050902 sec","job_status":"done","queue_duration_s":2.355782,"scheduling_latency_s":2.355872,"gitaly_calls":1,"gitaly_duration_s":0.016954,"redis_calls":12,"redis_duration_s":0.0026390000000000003,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000604,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.029507381,"duration_s":0.050902,"completed_at":"2026-08-16T16:46:32.440Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.572737] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:32.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"59cc7be29a1f629435a10c89","created_at":"2026-08-16T16:46:30.171Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-947fd9222cc04f9e","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ccc596e980060c843b30ce0093a1071ce17ffbf61eac2c3da18a053edfd19481","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.172Z","job_size_bytes":467,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-59cc7be29a1f629435a10c89: start","job_status":"start","queue_duration_s":2.269501,"scheduling_latency_s":2.269516} gitlab # [ 258.616268] gitaly[923]: time="2026-08-16T16:46:32.469Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T16:46:42.142" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:32.462" grpc.time_ms=6.882 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.632665] gitaly[923]: time="2026-08-16T16:46:32.541Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:47:02.498" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.498" grpc.time_ms=42.807 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.638719] gitaly[923]: time="2026-08-16T16:46:32.547Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=166 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T16:47:02.545" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.545" grpc.time_ms=2.238 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.662289] gitaly[923]: time="2026-08-16T16:46:32.571Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:42.245" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:32.565" grpc.time_ms=5.375 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.682667] gitaly[923]: time="2026-08-16T16:46:32.591Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFFY7MDD7QFZM7RAADVCQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:32.585" grpc.time_ms=6.154 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 258.693930] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:32 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 200 gitlab # [ 258.733094] gitaly[923]: time="2026-08-16T16:46:32.642Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFG4JKVQ6ATW9H918B4YB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:32.632" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 258.734098] gitaly[923]: time="2026-08-16T16:46:32.642Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFG4JKVQ6ATW9H918B4YB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:32.632" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 258.752226] gitaly[923]: time="2026-08-16T16:46:32.661Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFG4JKVQ6ATW9H918B4YB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:32.632" grpc.time_ms=28.191 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 258.753049] gitlab-workhorse[828]: time="2026-08-16T16:46:32Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 258.753726] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:32 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 67 gitlab # [ 258.787367] nixbot[2639]: {"ts": "2026-08-16T16:46:32.696Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 258.850280] nixbot[2639]: INFO: ::ffff:127.0.0.1:49932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.03 seconds) gitlab # [ 258.855590] gitaly[923]: time="2026-08-16T16:46:32.764Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFG83AKCGW7ZW82WYN968 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:02.462" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.763" grpc.time_ms=0.85 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.897355] gitaly[923]: time="2026-08-16T16:46:32.806Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05QFG83AKCGW7ZW82WYN968 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:42.029" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:32.799" grpc.time_ms=6.51 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.955106] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:32 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 156 gitlab # [ 258.956125] nixbot[2639]: {"ts": "2026-08-16T16:46:32.865Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e \"HTTP/1.1 201 Created\""} gitlab # [ 258.977087] gitaly[923]: time="2026-08-16T16:46:32.885Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T16:47:02.869" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.869" grpc.time_ms=16.073 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.998187] gitaly[923]: time="2026-08-16T16:46:32.907Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFGD64JGH1YG322MTA08Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:02.606" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.906" grpc.time_ms=0.498 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.027168] gitaly[923]: time="2026-08-16T16:46:32.936Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QFGD64JGH1YG322MTA08Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:42.157" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:32.927" grpc.time_ms=8.323 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.039799] gitaly[923]: time="2026-08-16T16:46:32.948Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDSZY2VY4312PF871SY5F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T16:47:02.028" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:32.928" grpc.time_ms=20.317 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.065040] sidekiq-cluster[2534]: {"severity":"WARN","time":"2026-08-16T16:46:32.973Z","class":"CreatePipelineWorker","correlation_id":"01M05QDSZY2VY4312PF871SY5F","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e","after":"cd17408d6c89a30d2788fd8b48218458c0bbf791","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"cd17408d6c89a30d2788fd8b48218458c0bbf791","ref":"refs/heads/master"},"retry":0} gitlab # [ 259.069375] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:32.978Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"59cc7be29a1f629435a10c89","created_at":"2026-08-16T16:46:30.171Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-947fd9222cc04f9e","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ccc596e980060c843b30ce0093a1071ce17ffbf61eac2c3da18a053edfd19481","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.172Z","job_size_bytes":467,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-59cc7be29a1f629435a10c89: done: 0.535915 sec","job_status":"done","queue_duration_s":2.269501,"scheduling_latency_s":2.269516,"gitaly_calls":7,"gitaly_duration_s":0.170246,"redis_calls":33,"redis_duration_s":0.005137,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000428,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003303,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00062,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.379979,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.535915,"completed_at":"2026-08-16T16:46:32.978Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019549,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.073492] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:32.981Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a0bccab8-29d3-4673-aafc-7eefed293145\"}"],"class":"WebHookWorker","jid":"1766cc7e2624add7b65f12b0","created_at":"2026-08-16T16:46:30.193Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-947fd9222cc04f9e","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c119e295bd16092f92356fef8af1dae8f15aae3155ecfcab6ddfd85dc0eea331","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.196Z","job_size_bytes":1749,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1766cc7e2624add7b65f12b0: start","job_status":"start","queue_duration_s":2.784706,"scheduling_latency_s":2.784806} gitlab # [ 259.107652] nixbot[2639]: INFO: ::ffff:127.0.0.1:49946 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 259.115259] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.023Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a0bccab8-29d3-4673-aafc-7eefed293145\"}"],"class":"WebHookWorker","jid":"1766cc7e2624add7b65f12b0","created_at":"2026-08-16T16:46:30.193Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-947fd9222cc04f9e","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c119e295bd16092f92356fef8af1dae8f15aae3155ecfcab6ddfd85dc0eea331","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.196Z","job_size_bytes":1749,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1766cc7e2624add7b65f12b0: done: 0.043028 sec","job_status":"done","queue_duration_s":2.784706,"scheduling_latency_s":2.784806,"redis_calls":14,"redis_duration_s":0.002311,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000266,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001267,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000778,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006859252000026572,"cpu_s":0.026255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.043028,"completed_at":"2026-08-16T16:46:33.023Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.126570] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.025Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f3515495a7492fc00d85454f","created_at":"2026-08-16T16:46:30.709Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.714Z","job_size_bytes":23,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f3515495a7492fc00d85454f: start","job_status":"start","queue_duration_s":2.31071,"scheduling_latency_s":2.31073} gitlab # [ 259.174707] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.079Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f3515495a7492fc00d85454f","created_at":"2026-08-16T16:46:30.709Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.714Z","job_size_bytes":23,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f3515495a7492fc00d85454f: done: 0.0547 sec","job_status":"done","queue_duration_s":2.31071,"scheduling_latency_s":2.31073,"redis_calls":10,"redis_duration_s":0.002186,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001505,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000837258,"duration_s":0.0547,"completed_at":"2026-08-16T16:46:33.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011791,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.175273] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.081Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"be69258f64ef885ea99230fa","created_at":"2026-08-16T16:46:30.950Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.955Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-be69258f64ef885ea99230fa: start","job_status":"start","queue_duration_s":2.126297,"scheduling_latency_s":2.126311} gitlab # [ 259.188554] nixbot[2639]: {"ts": "2026-08-16T16:46:33.051Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e \"HTTP/1.1 201 Created\""} gitlab # [ 259.190624] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 179 gitlab # [ 259.192624] gitaly[923]: time="2026-08-16T16:46:33.097Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFGJZ2HDBSPW0VX8HD2J4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:03.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:33.096" grpc.time_ms=0.608 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.203054] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.106Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"be69258f64ef885ea99230fa","created_at":"2026-08-16T16:46:30.950Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.955Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-be69258f64ef885ea99230fa: done: 0.025181 sec","job_status":"done","queue_duration_s":2.126297,"scheduling_latency_s":2.126311,"redis_calls":10,"redis_duration_s":0.002084,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001536,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025506,"duration_s":0.025181,"completed_at":"2026-08-16T16:46:33.106Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.239642] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.107Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ba249a3863935e5839b2d596","created_at":"2026-08-16T16:46:30.965Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.971Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ba249a3863935e5839b2d596: start","job_status":"start","queue_duration_s":2.136666,"scheduling_latency_s":2.13668} gitlab # [ 259.277601] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.137Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ba249a3863935e5839b2d596","created_at":"2026-08-16T16:46:30.965Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.971Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ba249a3863935e5839b2d596: done: 0.029984 sec","job_status":"done","queue_duration_s":2.136666,"scheduling_latency_s":2.13668,"redis_calls":10,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000353,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024193,"duration_s":0.029984,"completed_at":"2026-08-16T16:46:33.137Z","load_balancing_strategy":"primary","db_duration_s":0.005462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.285552] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.138Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a0bb823a150b13f4526f9ae7","created_at":"2026-08-16T16:46:30.982Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.986Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a0bb823a150b13f4526f9ae7: start","job_status":"start","queue_duration_s":2.152761,"scheduling_latency_s":2.152777} gitlab # [ 259.298096] nixbot[2639]: {"ts": "2026-08-16T16:46:33.164Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e \"HTTP/1.1 201 Created\""} gitlab # [ 259.300181] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f48ee74eaf0ef92fcd9605bf7e4865b4ed24e96e HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 108 gitlab # [ 259.302801] gitaly[923]: time="2026-08-16T16:46:33.125Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QFGJZ2HDBSPW0VX8HD2J4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:43.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:33.119" grpc.time_ms=5.989 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.339597] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.237Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a0bb823a150b13f4526f9ae7","created_at":"2026-08-16T16:46:30.982Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.986Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a0bb823a150b13f4526f9ae7: done: 0.098062 sec","job_status":"done","queue_duration_s":2.152761,"scheduling_latency_s":2.152777,"redis_calls":13,"redis_duration_s":0.0018059999999999999,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000453,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231314,"duration_s":0.098062,"completed_at":"2026-08-16T16:46:33.236Z","load_balancing_strategy":"primary","db_duration_s":0.00429,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.379470] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d022a48cb3b61bbb06266c60","created_at":"2026-08-16T16:46:30.986Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.991Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d022a48cb3b61bbb06266c60: start","job_status":"start","queue_duration_s":2.247494,"scheduling_latency_s":2.247515} gitlab # [ 259.380133] gitaly[923]: time="2026-08-16T16:46:33.264Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFGK6EQE1EXQ0C38QX4P4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.257" grpc.time_ms=6.418 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.380753] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:33 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 202 gitlab # [ 259.381229] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.273Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d022a48cb3b61bbb06266c60","created_at":"2026-08-16T16:46:30.986Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.991Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d022a48cb3b61bbb06266c60: done: 0.034385 sec","job_status":"done","queue_duration_s":2.247494,"scheduling_latency_s":2.247515,"redis_calls":10,"redis_duration_s":0.004862,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000271543,"duration_s":0.034385,"completed_at":"2026-08-16T16:46:33.273Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004515,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.425995] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.274Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3cf251240c75b0fde8e97312","created_at":"2026-08-16T16:46:30.992Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.000Z","job_size_bytes":19,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3cf251240c75b0fde8e97312: start","job_status":"start","queue_duration_s":2.27443,"scheduling_latency_s":2.274447} gitlab # [ 259.426774] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.300Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3cf251240c75b0fde8e97312","created_at":"2026-08-16T16:46:30.992Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.000Z","job_size_bytes":19,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3cf251240c75b0fde8e97312: done: 0.025726 sec","job_status":"done","queue_duration_s":2.27443,"scheduling_latency_s":2.274447,"redis_calls":11,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000352,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230476,"duration_s":0.025726,"completed_at":"2026-08-16T16:46:33.300Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.469995] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.302Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"df297c9bc21216fb50ab10c4","created_at":"2026-08-16T16:46:31.004Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.009Z","job_size_bytes":66,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-df297c9bc21216fb50ab10c4: start","job_status":"start","queue_duration_s":2.292282,"scheduling_latency_s":2.292306} gitlab # [ 259.470780] gitlab-workhorse[828]: time="2026-08-16T16:46:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 259.472154] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:33 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 46 gitlab # [ 259.473738] gitaly[923]: time="2026-08-16T16:46:33.312Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFGSJFFHGA89AYCJ8CMW6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.306" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 259.482058] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.329Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"df297c9bc21216fb50ab10c4","created_at":"2026-08-16T16:46:31.004Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.009Z","job_size_bytes":66,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-df297c9bc21216fb50ab10c4: done: 0.027697 sec","job_status":"done","queue_duration_s":2.292282,"scheduling_latency_s":2.292306,"redis_calls":10,"redis_duration_s":0.002706,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001353,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000295289,"duration_s":0.027697,"completed_at":"2026-08-16T16:46:33.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.520745] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.330Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"adf22c69420452264363f5a5","created_at":"2026-08-16T16:46:31.011Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.016Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-adf22c69420452264363f5a5: start","job_status":"start","queue_duration_s":2.314802,"scheduling_latency_s":2.314819} gitlab # [ 259.530647] nix-daemon[2847]: accepted connection from pid 3333, user nixbot gitlab # [ 259.531451] gitaly[923]: time="2026-08-16T16:46:33.312Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFGSJFFHGA89AYCJ8CMW6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.306" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.570646] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.358Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"adf22c69420452264363f5a5","created_at":"2026-08-16T16:46:31.011Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.016Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-adf22c69420452264363f5a5: done: 0.027515 sec","job_status":"done","queue_duration_s":2.314802,"scheduling_latency_s":2.314819,"redis_calls":10,"redis_duration_s":0.001386,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205892,"duration_s":0.027515,"completed_at":"2026-08-16T16:46:33.358Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.577180] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.359Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"83b726a03e2896446aa92fd2","created_at":"2026-08-16T16:46:31.023Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.028Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-83b726a03e2896446aa92fd2: start","job_status":"start","queue_duration_s":2.33083,"scheduling_latency_s":2.330844} gitlab # [ 259.590746] gitaly[923]: time="2026-08-16T16:46:33.312Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFGSJFFHGA89AYCJ8CMW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.306" grpc.time_ms=5.727 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.602328] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.386Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"83b726a03e2896446aa92fd2","created_at":"2026-08-16T16:46:31.023Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.028Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-83b726a03e2896446aa92fd2: done: 0.027169 sec","job_status":"done","queue_duration_s":2.33083,"scheduling_latency_s":2.330844,"redis_calls":10,"redis_duration_s":0.002036,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000348,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001422,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219861,"duration_s":0.027169,"completed_at":"2026-08-16T16:46:33.386Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007834,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.640051] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.388Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f63897bcf80a472e10c9a49d","created_at":"2026-08-16T16:46:31.029Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.035Z","job_size_bytes":6,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f63897bcf80a472e10c9a49d: start","job_status":"start","queue_duration_s":2.35291,"scheduling_latency_s":2.352924} gitlab # [ 259.650832] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.407Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f63897bcf80a472e10c9a49d","created_at":"2026-08-16T16:46:31.029Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.035Z","job_size_bytes":6,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f63897bcf80a472e10c9a49d: done: 0.019903 sec","job_status":"done","queue_duration_s":2.35291,"scheduling_latency_s":2.352924,"redis_calls":10,"redis_duration_s":0.0018,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000415,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000402,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000251708,"duration_s":0.019903,"completed_at":"2026-08-16T16:46:33.407Z","load_balancing_strategy":"primary","db_duration_s":0.001845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.707717] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.408Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"200bf242a4fed0a3a4be5dc5","created_at":"2026-08-16T16:46:31.035Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.040Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-200bf242a4fed0a3a4be5dc5: start","job_status":"start","queue_duration_s":2.368203,"scheduling_latency_s":2.368215} gitlab # [ 259.708515] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.433Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"200bf242a4fed0a3a4be5dc5","created_at":"2026-08-16T16:46:31.035Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.040Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-200bf242a4fed0a3a4be5dc5: done: 0.024201 sec","job_status":"done","queue_duration_s":2.368203,"scheduling_latency_s":2.368215,"redis_calls":10,"redis_duration_s":0.001343,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205054,"duration_s":0.024201,"completed_at":"2026-08-16T16:46:33.433Z","load_balancing_strategy":"primary","db_duration_s":0.004403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.733675] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.434Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"42b6c4b5aaee928be262a332","created_at":"2026-08-16T16:46:31.047Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.052Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-42b6c4b5aaee928be262a332: start","job_status":"start","queue_duration_s":2.381935,"scheduling_latency_s":2.381948} gitlab # [ 259.747084] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:33 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 37 gitlab # [ 259.748500] gitaly[923]: time="2026-08-16T16:46:33.576Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFH22YYFJ40RCT5HB42QT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.570" grpc.time_ms=5.845 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.784291] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.474Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"42b6c4b5aaee928be262a332","created_at":"2026-08-16T16:46:31.047Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.052Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-42b6c4b5aaee928be262a332: done: 0.040847 sec","job_status":"done","queue_duration_s":2.381935,"scheduling_latency_s":2.381948,"redis_calls":14,"redis_duration_s":0.001822,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209524,"duration_s":0.040847,"completed_at":"2026-08-16T16:46:33.474Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.829154] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.475Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8e2465ae6f25aae75915531f","created_at":"2026-08-16T16:46:31.121Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.124Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8e2465ae6f25aae75915531f: start","job_status":"start","queue_duration_s":2.351612,"scheduling_latency_s":2.351625} gitlab # [ 259.829623] gitaly[923]: time="2026-08-16T16:46:33.674Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:33.674" grpc.time_ms=0.336 pid=923 span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 259.830168] gitaly[923]: time="2026-08-16T16:46:33.706Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFH3A44GHXKMQMKC2AQ9J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.698" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 259.830747] gitlab-workhorse[828]: time="2026-08-16T16:46:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 259.831187] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:33 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 128 gitlab # [ 259.831936] gitaly[923]: time="2026-08-16T16:46:33.706Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFH3A44GHXKMQMKC2AQ9J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.698" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.868491] gitaly[923]: time="2026-08-16T16:46:33.706Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFH3A44GHXKMQMKC2AQ9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.698" grpc.time_ms=8.054 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.869083] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:33 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 36 gitlab # [ 259.869527] gitaly[923]: time="2026-08-16T16:46:33.769Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFH85N2H99QBA88GN165Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.763" grpc.time_ms=6.136 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.896482] nixbot[2639]: INFO: ::ffff:127.0.0.1:49962 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.04 seconds) gitlab # [ 259.906390] gitaly[923]: time="2026-08-16T16:46:33.815Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:33.814" grpc.time_ms=0.323 pid=923 span.kind=server system=grpc gitlab # [ 259.918179] gitaly[923]: time="2026-08-16T16:46:33.827Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFH9BZYRXGA6FQZQYXGQD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.817" pid=923 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 259.918670] gitaly[923]: time="2026-08-16T16:46:33.827Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFH9BZYRXGA6FQZQYXGQD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.817" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.919245] gitaly[923]: time="2026-08-16T16:46:33.827Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFH9BZYRXGA6FQZQYXGQD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:33.817" grpc.time_ms=10.461 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.919869] gitlab-workhorse[828]: time="2026-08-16T16:46:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 259.920448] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:33 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 56 gitlab # [ 259.971089] gitaly[923]: time="2026-08-16T16:46:33.880Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:33.879" grpc.time_ms=0.291 pid=923 span.kind=server system=grpc gitlab # [ 259.986059] gitaly[923]: time="2026-08-16T16:46:33.895Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 diskcache=2404e313-d6ef-48b3-9b1c-009a6ebebf78 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:47:03.521" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:33.521" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.986740] gitaly[923]: time="2026-08-16T16:46:33.895Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=83 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=819200 command.minflt=7076 command.oublock=0 command.real_time_ms=366 command.spawn_token_fork_ms=0 command.system_time_ms=51 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:47:03.521" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:33.521" grpc.time_ms=373.209 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.005641] gitaly[923]: time="2026-08-16T16:46:33.914Z" level=info msg="finished unary call with code OK" catfile.duration_ms=14 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=14 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:03.698" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:33.899" grpc.time_ms=15.313 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.027585] gitaly[923]: time="2026-08-16T16:46:33.936Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:47:03.035" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:33.936" grpc.time_ms=0.56 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.038106] gitaly[923]: time="2026-08-16T16:46:33.947Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T16:47:03.731" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:33.931" grpc.time_ms=15.206 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.049599] gitaly[923]: time="2026-08-16T16:46:33.957Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QDTZZ8WCXDPQJX71681X9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:03.056" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:33.956" grpc.time_ms=0.44 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.050594] gitaly[923]: time="2026-08-16T16:46:33.959Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:43.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:33.953" grpc.time_ms=5.923 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.054830] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.963Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8e2465ae6f25aae75915531f","created_at":"2026-08-16T16:46:31.121Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.124Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2534,"job_status":"rescheduled","message":"PipelineProcessWorker JID-8e2465ae6f25aae75915531f: rescheduled"} gitlab # [ 260.062183] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.970Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8e2465ae6f25aae75915531f","created_at":"2026-08-16T16:46:31.121Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-ec1ee43f5bc846cb","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.124Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8e2465ae6f25aae75915531f: done: 0.495002 sec","job_status":"done","queue_duration_s":2.351612,"scheduling_latency_s":2.351625,"gitaly_calls":3,"gitaly_duration_s":0.379545,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008346000000000001,"redis_read_bytes":149,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.00036,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000576,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.001948,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003442,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000157,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000382,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089302,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.468976365,"duration_s":0.495002,"completed_at":"2026-08-16T16:46:33.970Z","load_balancing_strategy":"primary","db_duration_s":0.022405,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 260.098871] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:33.972Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a73b8423dedeb3053670c587","created_at":"2026-08-16T16:46:31.222Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-89d12e6ee4934005","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.228Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a73b8423dedeb3053670c587: start","job_status":"start","queue_duration_s":2.744271,"scheduling_latency_s":2.744296} gitlab # [ 260.100319] gitaly[923]: time="2026-08-16T16:46:33.984Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T16:46:43.034" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:46:33.984" grpc.time_ms=0.189 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.109168] gitaly[923]: time="2026-08-16T16:46:33.993Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T16:46:43.038" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:33.988" grpc.time_ms=5.281 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.120127] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.012Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a73b8423dedeb3053670c587","created_at":"2026-08-16T16:46:31.222Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-89d12e6ee4934005","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.228Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a73b8423dedeb3053670c587: done: 0.04028 sec","job_status":"done","queue_duration_s":2.744271,"scheduling_latency_s":2.744296,"redis_calls":19,"redis_duration_s":0.003159,"redis_read_bytes":22,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000611,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000401,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001251,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005676979,"duration_s":0.04028,"completed_at":"2026-08-16T16:46:34.012Z","load_balancing_strategy":"primary","db_duration_s":0.006497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.159034] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.013Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b66aa54d3877a13e7585caa1"],"class":"WebHooks::LogExecutionWorker","jid":"bd7626e47efd14d29b8b287c","created_at":"2026-08-16T16:46:32.368Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-7694cd8beec3430c","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e3e20d18b4f19dcc31910ff5ea3f72d1a7c83f7ed8dc33dcffc6a5bb62a337c5","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:32.376Z","job_size_bytes":2593,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-bd7626e47efd14d29b8b287c: start","job_status":"start","queue_duration_s":1.63691,"scheduling_latency_s":1.636923} gitlab # [ 260.199886] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.045Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b66aa54d3877a13e7585caa1"],"class":"WebHooks::LogExecutionWorker","jid":"bd7626e47efd14d29b8b287c","created_at":"2026-08-16T16:46:32.368Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-7694cd8beec3430c","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e3e20d18b4f19dcc31910ff5ea3f72d1a7c83f7ed8dc33dcffc6a5bb62a337c5","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:32.376Z","job_size_bytes":2593,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-bd7626e47efd14d29b8b287c: done: 0.031942 sec","job_status":"done","queue_duration_s":1.63691,"scheduling_latency_s":1.636923,"redis_calls":10,"redis_duration_s":0.001349,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000226844,"duration_s":0.031942,"completed_at":"2026-08-16T16:46:34.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.206660] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.046Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1766cc7e2624add7b65f12b0"],"class":"WebHooks::LogExecutionWorker","jid":"2c97a93722487a86d5237434","created_at":"2026-08-16T16:46:33.018Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-8b48f969b3044bd8","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f369e1a2720587fca1e29637c8c3434df0ca2de22c448d25f8fa04e9e8bf4aea","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.020Z","job_size_bytes":2590,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2c97a93722487a86d5237434: start","job_status":"start","queue_duration_s":1.026705,"scheduling_latency_s":1.02672} gitlab # [ 260.245630] gitaly[923]: time="2026-08-16T16:46:34.038Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:34.038" grpc.time_ms=0.335 pid=923 span.kind=server system=grpc gitlab # [ 260.246454] gitaly[923]: time="2026-08-16T16:46:34.057Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:34.056" grpc.time_ms=0.349 pid=923 span.kind=server system=grpc gitlab # [ 260.247036] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.069Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1766cc7e2624add7b65f12b0"],"class":"WebHooks::LogExecutionWorker","jid":"2c97a93722487a86d5237434","created_at":"2026-08-16T16:46:33.018Z","trace_propagation_headers":{"sentry-trace":"257f6c30670740da847d5359bb9d70b4-8b48f969b3044bd8","baggage":"sentry-trace_id=257f6c30670740da847d5359bb9d70b4,sentry-release=Unknown"},"correlation_id":"01M05QDSZY2VY4312PF871SY5F","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f369e1a2720587fca1e29637c8c3434df0ca2de22c448d25f8fa04e9e8bf4aea","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.020Z","job_size_bytes":2590,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2c97a93722487a86d5237434: done: 0.022377 sec","job_status":"done","queue_duration_s":1.026705,"scheduling_latency_s":1.02672,"redis_calls":7,"redis_duration_s":0.001976,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022377,"completed_at":"2026-08-16T16:46:34.069Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.291131] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.070Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9e8180535aaa8269d59a10bb","created_at":"2026-08-16T16:46:33.514Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.516Z","job_size_bytes":23,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9e8180535aaa8269d59a10bb: start","job_status":"start","queue_duration_s":0.553818,"scheduling_latency_s":0.553854} gitlab # [ 260.292032] gitaly[923]: time="2026-08-16T16:46:34.072Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 diskcache=54d7fd1e-e3e2-49b5-9468-216643f6ab16 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:46:43.045" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:46:33.995" pid=923 ref=refs/keep-around/cd17408d6c89a30d2788fd8b48218458c0bbf791 remote_ip="2001:db8:1::1" revision=cd17408d6c89a30d2788fd8b48218458c0bbf791 span.kind=server system=grpc username=root gitlab # [ 260.293402] nixbot[2639]: {"ts": "2026-08-16T16:46:34.170Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd17408d6c89a30d2788fd8b48218458c0bbf791 \"HTTP/1.1 201 Created\""} gitlab # [ 260.295235] nixbot[2639]: {"ts": "2026-08-16T16:46:34.176Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-cd17408d6c89-4"} gitlab # [ 260.297220] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.101Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9e8180535aaa8269d59a10bb","created_at":"2026-08-16T16:46:33.514Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.516Z","job_size_bytes":23,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9e8180535aaa8269d59a10bb: done: 0.031413 sec","job_status":"done","queue_duration_s":0.553818,"scheduling_latency_s":0.553854,"redis_calls":7,"redis_duration_s":0.001202,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031413,"completed_at":"2026-08-16T16:46:34.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006456,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 260.342579] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.103Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5841dbec2899f47c9b6044f3","created_at":"2026-08-16T16:46:33.900Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.903Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5841dbec2899f47c9b6044f3: start","job_status":"start","queue_duration_s":0.199623,"scheduling_latency_s":0.199672} gitlab # [ 260.378575] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 315 gitlab # [ 260.379506] gitaly[923]: time="2026-08-16T16:46:34.073Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=42 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5120 command.oublock=8 command.real_time_ms=67 command.spawn_token_fork_ms=0 command.system_time_ms=23 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:46:43.045" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:46:33.995" grpc.time_ms=77.518 pid=923 ref=refs/keep-around/cd17408d6c89a30d2788fd8b48218458c0bbf791 remote_ip="2001:db8:1::1" revision=cd17408d6c89a30d2788fd8b48218458c0bbf791 span.kind=server system=grpc username=root gitlab # [ 260.380255] nix-daemon[2847]: accepted connection from pid 3422, user nixbot gitlab # [ 260.382095] nix-daemon[2847]: accepted connection from pid 3430, user nixbot gitlab # [ 260.383572] nixbot[2639]: {"ts": "2026-08-16T16:46:34.283Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-cd17408d6c89-4", "argv0": "bwrap"} gitlab # [ 260.385742] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.127Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5841dbec2899f47c9b6044f3","created_at":"2026-08-16T16:46:33.900Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.903Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5841dbec2899f47c9b6044f3: done: 0.024601 sec","job_status":"done","queue_duration_s":0.199623,"scheduling_latency_s":0.199672,"redis_calls":7,"redis_duration_s":0.001132,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024601,"completed_at":"2026-08-16T16:46:34.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.396592] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.130Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4ac11de1292c11f14d03223d","created_at":"2026-08-16T16:46:33.909Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.912Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4ac11de1292c11f14d03223d: start","job_status":"start","queue_duration_s":0.217972,"scheduling_latency_s":0.21799} gitlab # [ 260.409797] gitaly[923]: time="2026-08-16T16:46:34.077Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:04.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:34.076" grpc.time_ms=0.463 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.451542] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.150Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4ac11de1292c11f14d03223d","created_at":"2026-08-16T16:46:33.909Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.912Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4ac11de1292c11f14d03223d: done: 0.020795 sec","job_status":"done","queue_duration_s":0.217972,"scheduling_latency_s":0.21799,"redis_calls":7,"redis_duration_s":0.001019,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020795,"completed_at":"2026-08-16T16:46:34.150Z","load_balancing_strategy":"primary","db_duration_s":0.003458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.488677] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1c6968e3ba18021a225588b5","created_at":"2026-08-16T16:46:33.917Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.918Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1c6968e3ba18021a225588b5: start","job_status":"start","queue_duration_s":0.233026,"scheduling_latency_s":0.233051} gitlab # [ 260.489534] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.180Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1c6968e3ba18021a225588b5","created_at":"2026-08-16T16:46:33.917Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.918Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1c6968e3ba18021a225588b5: done: 0.028577 sec","job_status":"done","queue_duration_s":0.233026,"scheduling_latency_s":0.233051,"redis_calls":10,"redis_duration_s":0.002592,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000434,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000518,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028577,"completed_at":"2026-08-16T16:46:34.180Z","load_balancing_strategy":"primary","db_duration_s":0.006715,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.526103] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.181Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f93292f12b540789fff53e43","created_at":"2026-08-16T16:46:33.919Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.920Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f93292f12b540789fff53e43: start","job_status":"start","queue_duration_s":0.260674,"scheduling_latency_s":0.26069} gitlab # [ 260.526798] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.198Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f93292f12b540789fff53e43","created_at":"2026-08-16T16:46:33.919Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.920Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f93292f12b540789fff53e43: done: 0.016862 sec","job_status":"done","queue_duration_s":0.260674,"scheduling_latency_s":0.26069,"redis_calls":7,"redis_duration_s":0.000906,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016862,"completed_at":"2026-08-16T16:46:34.198Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.567975] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.199Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"76c32c1821039fad52b58d38","created_at":"2026-08-16T16:46:33.921Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.922Z","job_size_bytes":19,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-76c32c1821039fad52b58d38: start","job_status":"start","queue_duration_s":0.276996,"scheduling_latency_s":0.277009} gitlab # [ 260.568676] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.218Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"76c32c1821039fad52b58d38","created_at":"2026-08-16T16:46:33.921Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.922Z","job_size_bytes":19,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-76c32c1821039fad52b58d38: done: 0.019065 sec","job_status":"done","queue_duration_s":0.276996,"scheduling_latency_s":0.277009,"redis_calls":8,"redis_duration_s":0.002164,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001579,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019065,"completed_at":"2026-08-16T16:46:34.218Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.608565] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.219Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"d5f35899af583ca0ad574034","created_at":"2026-08-16T16:46:33.923Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.924Z","job_size_bytes":66,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-d5f35899af583ca0ad574034: start","job_status":"start","queue_duration_s":0.295429,"scheduling_latency_s":0.295445} gitlab # [ 260.612552] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.240Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"d5f35899af583ca0ad574034","created_at":"2026-08-16T16:46:33.923Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.924Z","job_size_bytes":66,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-d5f35899af583ca0ad574034: done: 0.021243 sec","job_status":"done","queue_duration_s":0.295429,"scheduling_latency_s":0.295445,"redis_calls":7,"redis_duration_s":0.0011589999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000316,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021243,"completed_at":"2026-08-16T16:46:34.240Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.672972] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.242Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3fdf04c9d4b7748fcb964497","created_at":"2026-08-16T16:46:33.924Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.925Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3fdf04c9d4b7748fcb964497: start","job_status":"start","queue_duration_s":0.316885,"scheduling_latency_s":0.316905} gitlab # [ 260.673365] gitaly[923]: time="2026-08-16T16:46:34.504Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:47:04.503" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:34.504" grpc.time_ms=0.689 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.674036] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.265Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3fdf04c9d4b7748fcb964497","created_at":"2026-08-16T16:46:33.924Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.925Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3fdf04c9d4b7748fcb964497: done: 0.022882 sec","job_status":"done","queue_duration_s":0.316885,"scheduling_latency_s":0.316905,"redis_calls":7,"redis_duration_s":0.001974,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022882,"completed_at":"2026-08-16T16:46:34.265Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.725742] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.266Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"297a6a59b47d7dec8edc5fc9","created_at":"2026-08-16T16:46:33.925Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.926Z","job_size_bytes":6,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-297a6a59b47d7dec8edc5fc9: start","job_status":"start","queue_duration_s":0.339704,"scheduling_latency_s":0.339719} gitlab # [ 260.726558] gitaly[923]: time="2026-08-16T16:46:34.534Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFHBYX43PJY42N1BV3V19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:04.533" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:34.534" grpc.time_ms=0.513 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.727904] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.279Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"297a6a59b47d7dec8edc5fc9","created_at":"2026-08-16T16:46:33.925Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.926Z","job_size_bytes":6,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-297a6a59b47d7dec8edc5fc9: done: 0.0132 sec","job_status":"done","queue_duration_s":0.339704,"scheduling_latency_s":0.339719,"redis_calls":7,"redis_duration_s":0.002007,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0132,"completed_at":"2026-08-16T16:46:34.279Z","load_balancing_strategy":"primary","db_duration_s":0.000351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.788055] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.280Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"45075cb628414ae2a2a38561","created_at":"2026-08-16T16:46:33.926Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.927Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-45075cb628414ae2a2a38561: start","job_status":"start","queue_duration_s":0.352911,"scheduling_latency_s":0.352932} gitlab # [ 260.788701] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.307Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"45075cb628414ae2a2a38561","created_at":"2026-08-16T16:46:33.926Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.927Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-45075cb628414ae2a2a38561: done: 0.02682 sec","job_status":"done","queue_duration_s":0.352911,"scheduling_latency_s":0.352932,"redis_calls":7,"redis_duration_s":0.004721,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003923,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02682,"completed_at":"2026-08-16T16:46:34.307Z","load_balancing_strategy":"primary","db_duration_s":0.006261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.806784] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.310Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f40c5a45210cbe6ccc81020b","created_at":"2026-08-16T16:46:33.964Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.966Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f40c5a45210cbe6ccc81020b: start","job_status":"start","queue_duration_s":0.343985,"scheduling_latency_s":0.344002} gitlab # [ 260.842229] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.331Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f40c5a45210cbe6ccc81020b","created_at":"2026-08-16T16:46:33.964Z","trace_propagation_headers":{"sentry-trace":"8089cb36dbb64a72832f4e9498670a48-7cc12e1a6bdc4295","baggage":"sentry-trace_id=8089cb36dbb64a72832f4e9498670a48,sentry-release=Unknown"},"correlation_id":"01M05QDTZZ8WCXDPQJX71681X9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.966Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f40c5a45210cbe6ccc81020b: done: 0.021599 sec","job_status":"done","queue_duration_s":0.343985,"scheduling_latency_s":0.344002,"redis_calls":8,"redis_duration_s":0.00237,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001842,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000528,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021599,"completed_at":"2026-08-16T16:46:34.331Z","load_balancing_strategy":"primary","db_duration_s":0.005595,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791' gitlab # [ 260.877606] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.333Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"a390a50662358dd52407108e","created_at":"2026-08-16T16:46:34.002Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-e03f3f4d5f764e7d","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:34.006Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-a390a50662358dd52407108e: start","job_status":"start","queue_duration_s":0.32695,"scheduling_latency_s":0.326965} gitlab # [ 260.878457] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.400Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"a390a50662358dd52407108e","created_at":"2026-08-16T16:46:34.002Z","trace_propagation_headers":{"sentry-trace":"98a1fe5059a040f68d69bc58ac4de8ba-e03f3f4d5f764e7d","baggage":"sentry-trace_id=98a1fe5059a040f68d69bc58ac4de8ba,sentry-release=Unknown"},"correlation_id":"01M05QDNYDM379Q5R1CEFAA8SW","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:34.006Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-a390a50662358dd52407108e: done: 0.067846 sec","job_status":"done","queue_duration_s":0.32695,"scheduling_latency_s":0.326965,"redis_calls":11,"redis_duration_s":0.0017439999999999999,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210641,"duration_s":0.067846,"completed_at":"2026-08-16T16:46:34.400Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.931726] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.402Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bd2d06571d14efa9ec6ec5be","created_at":"2026-08-16T16:46:34.082Z","trace_propagation_headers":{"sentry-trace":"a47444c3c9544629b0c187fb767ade2d-0d3eeb52817e4eb7","baggage":"sentry-trace_id=a47444c3c9544629b0c187fb767ade2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QFHBYX43PJY42N1BV3V19","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:34.085Z","job_size_bytes":65,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bd2d06571d14efa9ec6ec5be: start","job_status":"start","queue_duration_s":0.316302,"scheduling_latency_s":0.316316} gitlab # [ 260.932472] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.420Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bd2d06571d14efa9ec6ec5be","created_at":"2026-08-16T16:46:34.082Z","trace_propagation_headers":{"sentry-trace":"a47444c3c9544629b0c187fb767ade2d-0d3eeb52817e4eb7","baggage":"sentry-trace_id=a47444c3c9544629b0c187fb767ade2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QFHBYX43PJY42N1BV3V19","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:34.085Z","job_size_bytes":65,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bd2d06571d14efa9ec6ec5be: done: 0.018637 sec","job_status":"done","queue_duration_s":0.316302,"scheduling_latency_s":0.316316,"redis_calls":7,"redis_duration_s":0.000981,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018637,"completed_at":"2026-08-16T16:46:34.420Z","load_balancing_strategy":"primary","db_duration_s":0.003065,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 260.969278] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.421Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8a8af4525a3fca2a0c944734","created_at":"2026-08-16T16:46:34.087Z","trace_propagation_headers":{"sentry-trace":"a47444c3c9544629b0c187fb767ade2d-0d3eeb52817e4eb7","baggage":"sentry-trace_id=a47444c3c9544629b0c187fb767ade2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QFHBYX43PJY42N1BV3V19","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:34.090Z","job_size_bytes":65,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8a8af4525a3fca2a0c944734: start","job_status":"start","queue_duration_s":0.331317,"scheduling_latency_s":0.331332} gitlab # [ 260.970033] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.453Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8a8af4525a3fca2a0c944734","created_at":"2026-08-16T16:46:34.087Z","trace_propagation_headers":{"sentry-trace":"a47444c3c9544629b0c187fb767ade2d-0d3eeb52817e4eb7","baggage":"sentry-trace_id=a47444c3c9544629b0c187fb767ade2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QFHBYX43PJY42N1BV3V19","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:34.090Z","job_size_bytes":65,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8a8af4525a3fca2a0c944734: done: 0.032384 sec","job_status":"done","queue_duration_s":0.331317,"scheduling_latency_s":0.331332,"redis_calls":10,"redis_duration_s":0.001339,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000664,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032384,"completed_at":"2026-08-16T16:46:34.453Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008568,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.997510] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.454Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a955048d008b96eb67c25353","created_at":"2026-08-16T16:46:34.152Z","trace_propagation_headers":{"sentry-trace":"a47444c3c9544629b0c187fb767ade2d-0d3eeb52817e4eb7","baggage":"sentry-trace_id=a47444c3c9544629b0c187fb767ade2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QFHBYX43PJY42N1BV3V19","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:34.154Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a955048d008b96eb67c25353: start","job_status":"start","queue_duration_s":0.299865,"scheduling_latency_s":0.29988} gitlab # [ 261.037835] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.544Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a955048d008b96eb67c25353","created_at":"2026-08-16T16:46:34.152Z","trace_propagation_headers":{"sentry-trace":"a47444c3c9544629b0c187fb767ade2d-0d3eeb52817e4eb7","baggage":"sentry-trace_id=a47444c3c9544629b0c187fb767ade2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QFHBYX43PJY42N1BV3V19","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:34.154Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a955048d008b96eb67c25353: done: 0.089711 sec","job_status":"done","queue_duration_s":0.299865,"scheduling_latency_s":0.29988,"gitaly_calls":2,"gitaly_duration_s":0.006604,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.0042899999999999995,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.0006,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000822,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000172,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000146,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000375,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000584,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065449,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.069311882,"duration_s":0.089711,"completed_at":"2026-08-16T16:46:34.544Z","load_balancing_strategy":"primary","db_duration_s":0.018317,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 261.081610] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.546Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"4af383d2fa5eb547a133a5b0","created_at":"2026-08-16T16:46:34.493Z","trace_propagation_headers":{"sentry-trace":"a47444c3c9544629b0c187fb767ade2d-b7cb9680b550463e","baggage":"sentry-trace_id=a47444c3c9544629b0c187fb767ade2d,sentry-release=Unknown"},"correlation_id":"01M05QFHBYX43PJY42N1BV3V19","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:34.494Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4af383d2fa5eb547a133a5b0: start","job_status":"start","queue_duration_s":0.051215,"scheduling_latency_s":0.051231} gitlab # [ 261.082259] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:34.569Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"4af383d2fa5eb547a133a5b0","created_at":"2026-08-16T16:46:34.493Z","trace_propagation_headers":{"sentry-trace":"a47444c3c9544629b0c187fb767ade2d-b7cb9680b550463e","baggage":"sentry-trace_id=a47444c3c9544629b0c187fb767ade2d,sentry-release=Unknown"},"correlation_id":"01M05QFHBYX43PJY42N1BV3V19","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:34.494Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4af383d2fa5eb547a133a5b0: done: 0.023539 sec","job_status":"done","queue_duration_s":0.051215,"scheduling_latency_s":0.051231,"redis_calls":7,"redis_duration_s":0.000944,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023539,"completed_at":"2026-08-16T16:46:34.569Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003222,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.152076] nixbot[2639]: INFO: ::ffff:127.0.0.1:49978 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd17408d6c89a30d2788fd8b48218458c0bbf791', in 0.26 seconds) (finished: subtest: push delivers the webhook, in 58.11 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd17408d6c89a30d2788fd8b48218458c0bbf791/statuses gitlab # [ 261.196141] nix-daemon[2847]: accepted connection from pid 3444, user nixbot gitlab # [ 261.212434] gitaly[923]: time="2026-08-16T16:46:35.121Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJJE8A8W48MFZZCDBGYP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:05.120" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:35.120" grpc.time_ms=0.5 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.236088] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd17408d6c89a30d2788fd8b48218458c0bbf791/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 57 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd17408d6c89a30d2788fd8b48218458c0bbf791/statuses, in 0.08 seconds) gitlab # [ 261.240430] nix-daemon[2847]: accepted connection from pid 3460, user nixbot gitlab # [ 261.251340] nix-daemon[2847]: accepted connection from pid 3444, user nixbot gitlab # [ 261.322188] gitaly[923]: time="2026-08-16T16:46:35.230Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:05.229" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:35.229" grpc.time_ms=0.929 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.353490] gitaly[923]: time="2026-08-16T16:46:35.262Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:45.045" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:35.255" grpc.time_ms=6.702 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.380037] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.287Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0742fcd5759a35de655d5d6d","created_at":"2026-08-16T16:46:35.283Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-e6659e4a105d4dc6","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.285Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0742fcd5759a35de655d5d6d: start","job_status":"start","queue_duration_s":0.001815,"scheduling_latency_s":0.00187} gitlab # [ 261.399326] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 118 gitlab # [ 261.401906] nixbot[2639]: {"ts": "2026-08-16T16:46:35.309Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd17408d6c89a30d2788fd8b48218458c0bbf791 \"HTTP/1.1 201 Created\""} gitlab # [ 261.464843] gitaly[923]: time="2026-08-16T16:46:35.373Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJSKC80TSTKKS7AXMGNP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:05.371" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:35.372" grpc.time_ms=0.673 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.510266] gitaly[923]: time="2026-08-16T16:46:35.419Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFJSKC80TSTKKS7AXMGNP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:45.300" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:35.410" grpc.time_ms=8.402 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.510911] gitaly[923]: time="2026-08-16T16:46:35.419Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:35.419" grpc.time_ms=0.266 pid=923 span.kind=server system=grpc gitlab # [ 261.547071] gitaly[923]: time="2026-08-16T16:46:35.456Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:35.455" grpc.time_ms=0.282 pid=923 span.kind=server system=grpc gitlab # [ 261.551113] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 144 gitlab # [ 261.552710] nixbot[2639]: {"ts": "2026-08-16T16:46:35.461Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd17408d6c89a30d2788fd8b48218458c0bbf791 \"HTTP/1.1 201 Created\""} gitlab # [ 261.581314] gitaly[923]: time="2026-08-16T16:46:35.490Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:35.490" grpc.time_ms=0.267 pid=923 span.kind=server system=grpc gitlab # [ 261.592458] gitaly[923]: time="2026-08-16T16:46:35.501Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:47:05.384" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:35.384" operations="[repack_refs]" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.593891] gitaly[923]: time="2026-08-16T16:46:35.502Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:47:05.384" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:35.384" pid=923 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-16 16:45:31.479706616 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 261.602129] gitaly[923]: time="2026-08-16T16:46:35.510Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJYH9N8BKWVGZW3BZT8F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:05.509" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:35.509" grpc.time_ms=1.058 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.608217] gitaly[923]: time="2026-08-16T16:46:35.517Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:47:05.384" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:35.384" pid=923 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 261.608961] gitaly[923]: time="2026-08-16T16:46:35.517Z" level=info msg="optimized repository" clean_stale_data_time=13.925792ms clean_work_trees_time="68.444µs" commit_graph_time="3.911µs" correlation_id=01M05QFJNMJNP4196R3ZM3YPCK gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=923 prune_time="3.353µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.911µs" storage_name=default system=housekeeping total_time=14.095087ms gitlab # [ 261.609529] gitaly[923]: time="2026-08-16T16:46:35.517Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:47:05.384" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:35.384" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.628851] gitaly[923]: time="2026-08-16T16:46:35.537Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFJYH9N8BKWVGZW3BZT8F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:46:45.213" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:35.533" grpc.time_ms=4.412 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.660707] gitaly[923]: time="2026-08-16T16:46:35.569Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK diskcache=4f9b98b1-a590-4c99-99a7-66b9b003ddea grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:47:05.384" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:35.384" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.661597] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd17408d6c89a30d2788fd8b48218458c0bbf791 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 95 gitlab # [ 261.662184] nixbot[2639]: {"ts": "2026-08-16T16:46:35.570Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd17408d6c89a30d2788fd8b48218458c0bbf791 \"HTTP/1.1 201 Created\""} gitlab # [ 261.673317] gitaly[923]: time="2026-08-16T16:46:35.582Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=125 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=8851 command.oublock=0 command.real_time_ms=126 command.spawn_token_fork_ms=1 command.system_time_ms=72 command.user_time_ms=53 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:47:05.384" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:46:35.384" grpc.time_ms=185.098 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.722103] gitaly[923]: time="2026-08-16T16:46:35.629Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:47:05.628" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:35.628" grpc.time_ms=0.887 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.734087] nix-daemon[2847]: accepted connection from pid 3509, user nixbot gitlab # [ 261.749219] gitaly[923]: time="2026-08-16T16:46:35.658Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:05.657" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:35.657" grpc.time_ms=0.462 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.755896] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.664Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"703cb6b58eda0af1327334fc","created_at":"2026-08-16T16:46:35.663Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"0742fcd5759a35de655d5d6d","job_size_bytes":3,"pid":2534,"job_status":"deduplicated","message":"PipelineProcessWorker JID-703cb6b58eda0af1327334fc: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 261.756730] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.665Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0742fcd5759a35de655d5d6d","created_at":"2026-08-16T16:46:35.283Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-e6659e4a105d4dc6","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.285Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2534,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0742fcd5759a35de655d5d6d: rescheduled"} gitlab # [ 261.762969] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.671Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0742fcd5759a35de655d5d6d","created_at":"2026-08-16T16:46:35.283Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-e6659e4a105d4dc6","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.285Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0742fcd5759a35de655d5d6d: done: 0.38409 sec","job_status":"done","queue_duration_s":0.001815,"scheduling_latency_s":0.00187,"gitaly_calls":3,"gitaly_duration_s":0.204941,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011943,"redis_read_bytes":239,"redis_write_bytes":21783,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001164,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001021,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002524,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.003877,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000199,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.0005,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001494,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.015,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.1268,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.33609998,"duration_s":0.38409,"completed_at":"2026-08-16T16:46:35.671Z","load_balancing_strategy":"primary","db_duration_s":0.03863,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 261.814040] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.672Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"642ab7ca5d2210e296b0ebf9","created_at":"2026-08-16T16:46:35.377Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.379Z","job_size_bytes":23,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-642ab7ca5d2210e296b0ebf9: start","job_status":"start","queue_duration_s":0.293164,"scheduling_latency_s":0.29318} gitlab # [ 261.814767] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"642ab7ca5d2210e296b0ebf9","created_at":"2026-08-16T16:46:35.377Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.379Z","job_size_bytes":23,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-642ab7ca5d2210e296b0ebf9: done: 0.031001 sec","job_status":"done","queue_duration_s":0.293164,"scheduling_latency_s":0.29318,"redis_calls":7,"redis_duration_s":0.00093,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031001,"completed_at":"2026-08-16T16:46:35.703Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009418,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 261.854724] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.704Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e208a1f02fde4d5726e86650","created_at":"2026-08-16T16:46:35.587Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.589Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e208a1f02fde4d5726e86650: start","job_status":"start","queue_duration_s":0.114826,"scheduling_latency_s":0.11484} gitlab # [ 261.855556] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.721Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e208a1f02fde4d5726e86650","created_at":"2026-08-16T16:46:35.587Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.589Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e208a1f02fde4d5726e86650: done: 0.016753 sec","job_status":"done","queue_duration_s":0.114826,"scheduling_latency_s":0.11484,"redis_calls":7,"redis_duration_s":0.000918,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016753,"completed_at":"2026-08-16T16:46:35.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002404,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.908706] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.722Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2bc4ccc9e366a148f3880899","created_at":"2026-08-16T16:46:35.596Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.599Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2bc4ccc9e366a148f3880899: start","job_status":"start","queue_duration_s":0.123138,"scheduling_latency_s":0.123151} gitlab # [ 261.909496] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2bc4ccc9e366a148f3880899","created_at":"2026-08-16T16:46:35.596Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.599Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2bc4ccc9e366a148f3880899: done: 0.028751 sec","job_status":"done","queue_duration_s":0.123138,"scheduling_latency_s":0.123151,"redis_calls":7,"redis_duration_s":0.0037489999999999997,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003485,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028751,"completed_at":"2026-08-16T16:46:35.751Z","load_balancing_strategy":"primary","db_duration_s":0.004142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.928220] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.752Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"6f9a2e5b768a91491b3f3b4a","created_at":"2026-08-16T16:46:35.605Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.606Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6f9a2e5b768a91491b3f3b4a: start","job_status":"start","queue_duration_s":0.145367,"scheduling_latency_s":0.145382} gitlab # [ 261.973661] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.823Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"6f9a2e5b768a91491b3f3b4a","created_at":"2026-08-16T16:46:35.605Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.606Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6f9a2e5b768a91491b3f3b4a: done: 0.071101 sec","job_status":"done","queue_duration_s":0.145367,"scheduling_latency_s":0.145382,"redis_calls":10,"redis_duration_s":0.046965,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.045908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000375,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000682,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.071101,"completed_at":"2026-08-16T16:46:35.823Z","load_balancing_strategy":"primary","db_duration_s":0.005764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.008705] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.824Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c51dbc05fdbec48b4a315f3d","created_at":"2026-08-16T16:46:35.607Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.607Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c51dbc05fdbec48b4a315f3d: start","job_status":"start","queue_duration_s":0.21642,"scheduling_latency_s":0.216439} gitlab # [ 262.009545] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.844Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c51dbc05fdbec48b4a315f3d","created_at":"2026-08-16T16:46:35.607Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.607Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c51dbc05fdbec48b4a315f3d: done: 0.020324 sec","job_status":"done","queue_duration_s":0.21642,"scheduling_latency_s":0.216439,"redis_calls":7,"redis_duration_s":0.001293,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020324,"completed_at":"2026-08-16T16:46:35.844Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006082,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.045729] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.845Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"13543ce1477d9d377884b8f3","created_at":"2026-08-16T16:46:35.608Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.609Z","job_size_bytes":19,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-13543ce1477d9d377884b8f3: start","job_status":"start","queue_duration_s":0.236239,"scheduling_latency_s":0.236254} gitlab # [ 262.046500] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.860Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"13543ce1477d9d377884b8f3","created_at":"2026-08-16T16:46:35.608Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.609Z","job_size_bytes":19,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-13543ce1477d9d377884b8f3: done: 0.014739 sec","job_status":"done","queue_duration_s":0.236239,"scheduling_latency_s":0.236254,"redis_calls":8,"redis_duration_s":0.0011610000000000001,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014739,"completed_at":"2026-08-16T16:46:35.860Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.070052] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.861Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ce50c3c0a6f853087252e1a4","created_at":"2026-08-16T16:46:35.610Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.611Z","job_size_bytes":66,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ce50c3c0a6f853087252e1a4: start","job_status":"start","queue_duration_s":0.249717,"scheduling_latency_s":0.24973} gitlab # [ 262.109547] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.874Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ce50c3c0a6f853087252e1a4","created_at":"2026-08-16T16:46:35.610Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.611Z","job_size_bytes":66,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ce50c3c0a6f853087252e1a4: done: 0.013233 sec","job_status":"done","queue_duration_s":0.249717,"scheduling_latency_s":0.24973,"redis_calls":7,"redis_duration_s":0.0009109999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013233,"completed_at":"2026-08-16T16:46:35.874Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001573,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.145218] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.875Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"4dd348ec16956e30978ac164","created_at":"2026-08-16T16:46:35.612Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.613Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4dd348ec16956e30978ac164: start","job_status":"start","queue_duration_s":0.261848,"scheduling_latency_s":0.261861} gitlab # [ 262.145732] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.895Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"4dd348ec16956e30978ac164","created_at":"2026-08-16T16:46:35.612Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.613Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4dd348ec16956e30978ac164: done: 0.01979 sec","job_status":"done","queue_duration_s":0.261848,"scheduling_latency_s":0.261861,"redis_calls":7,"redis_duration_s":0.001008,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01979,"completed_at":"2026-08-16T16:46:35.895Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.196196] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.896Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"4d749b4f4fd2ed33a02089f5","created_at":"2026-08-16T16:46:35.616Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.618Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4d749b4f4fd2ed33a02089f5: start","job_status":"start","queue_duration_s":0.278285,"scheduling_latency_s":0.278358} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd17408d6c89a30d2788fd8b48218458c0bbf791/statuses gitlab # [ 262.196800] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.912Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"4d749b4f4fd2ed33a02089f5","created_at":"2026-08-16T16:46:35.616Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.618Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4d749b4f4fd2ed33a02089f5: done: 0.016089 sec","job_status":"done","queue_duration_s":0.278285,"scheduling_latency_s":0.278358,"redis_calls":7,"redis_duration_s":0.000979,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016089,"completed_at":"2026-08-16T16:46:35.912Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003736,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.233111] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.913Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"80b85ef57930c9b1ede483a5","created_at":"2026-08-16T16:46:35.618Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.619Z","job_size_bytes":6,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-80b85ef57930c9b1ede483a5: start","job_status":"start","queue_duration_s":0.293876,"scheduling_latency_s":0.293889} gitlab # [ 262.233741] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"80b85ef57930c9b1ede483a5","created_at":"2026-08-16T16:46:35.618Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.619Z","job_size_bytes":6,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-80b85ef57930c9b1ede483a5: done: 0.00835 sec","job_status":"done","queue_duration_s":0.293876,"scheduling_latency_s":0.293889,"redis_calls":7,"redis_duration_s":0.000918,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00835,"completed_at":"2026-08-16T16:46:35.921Z","load_balancing_strategy":"primary","db_duration_s":0.000254,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.274332] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.922Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"a41c08d29913b041d1dee252","created_at":"2026-08-16T16:46:35.619Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.620Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a41c08d29913b041d1dee252: start","job_status":"start","queue_duration_s":0.301929,"scheduling_latency_s":0.301941} gitlab # [ 262.274907] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.936Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"a41c08d29913b041d1dee252","created_at":"2026-08-16T16:46:35.619Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.620Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a41c08d29913b041d1dee252: done: 0.013534 sec","job_status":"done","queue_duration_s":0.301929,"scheduling_latency_s":0.301941,"redis_calls":7,"redis_duration_s":0.0009320000000000001,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013534,"completed_at":"2026-08-16T16:46:35.936Z","load_balancing_strategy":"primary","db_duration_s":0.002031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.300714] sidekiq-cluster[2534]: {"severity":"INFO","time":"2026-08-16T16:46:35.936Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"22857ec5b11a11eb27e6f262","created_at":"2026-08-16T16:46:35.665Z","trace_propagation_headers":{"sentry-trace":"bb22e886610e43a6a6761d49b5c80116-5473395ae7a347a2","baggage":"sentry-trace_id=bb22e886610e43a6a6761d49b5c80116,sentry-release=Unknown"},"correlation_id":"01M05QFJNMJNP4196R3ZM3YPCK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:35.666Z","job_size_bytes":3,"pid":2534,"sidekiq_tid":"m7xu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-22857ec5b11a11eb27e6f262: start","job_status":"start","queue_duration_s":0.270196,"scheduling_latency_s":0.270209} gitlab # [ 262.357885] gitaly[923]: time="2026-08-16T16:46:36.266Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QFK7CF9NFPSTB7KT75KH2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:36.261" grpc.time_ms=5.125 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 262.360098] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:36 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 511 gitlab # [ 262.375648] gitaly[923]: time="2026-08-16T16:46:36.284Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:36.284" grpc.time_ms=0.292 pid=923 span.kind=server system=grpc gitlab # [ 262.385843] gitaly[923]: time="2026-08-16T16:46:36.294Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFKPT2617766DZ44Y8RQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:47:06.293" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:46:36.293" grpc.time_ms=1.194 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.408137] gitaly[923]: time="2026-08-16T16:46:36.317Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:36.316" grpc.time_ms=0.295 pid=923 span.kind=server system=grpc gitlab # [ 262.410705] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd17408d6c89a30d2788fd8b48218458c0bbf791/statuses HTTP/1.1" 200 1316 "" "curl/8.21.0" 68 gitlab # [ 262.412981] gitaly[923]: time="2026-08-16T16:46:36.322Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QFKQE57AQ87HTFCB73346 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:36.314" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 262.413619] gitaly[923]: time="2026-08-16T16:46:36.322Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFKQE57AQ87HTFCB73346 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:36.314" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 262.414158] gitaly[923]: time="2026-08-16T16:46:36.322Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QFKQE57AQ87HTFCB73346 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:46:36.314" grpc.time_ms=7.88 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 262.414714] gitlab-workhorse[828]: time="2026-08-16T16:46:36Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 262.415145] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:36 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 51 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd17408d6c89a30d2788fd8b48218458c0bbf791/statuses, in 0.22 seconds) (finished: subtest: eval and build post commit statuses, in 1.30 seconds) (finished: run the VM test script, in 310.37 seconds) gitlab # [ 262.472519] gitaly[923]: time="2026-08-16T16:46:36.381Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QFJNMJNP4196R3ZM3YPCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:46:36.380" grpc.time_ms=0.321 pid=923 span.kind=server system=grpc test script finished in 310.39s cleanup kill QemuMachine (pid 46) gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.68 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-16T16:45:36.856Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'cd17408d6c89a30d2788fd8b48218458c0bbf791', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-16T16:46:33.848962Z', 'started_at': '2026-08-16T16:46:34.172255Z', 'finished_at': None}] [{'id': 5, 'sha': 'cd17408d6c89a30d2788fd8b48218458c0bbf791', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T16:46:34.145Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'cd17408d6c89a30d2788fd8b48218458c0bbf791', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-16T16:46:34.145Z', 'started_at': None, 'finished_at': '2026-08-16T16:46:35.276Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'cd17408d6c89a30d2788fd8b48218458c0bbf791', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-16T16:46:35.443Z', 'started_at': None, 'finished_at': '2026-08-16T16:46:35.550Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]